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PREFACE 

This  is  the  second  of  two  volumes  constituting  the  final  report  of  an 
IS-month  study  entitled  "The  Normative  Structure  of  Knowledge  Production 
and  Utilization  in  Education,"  performed  by  Stanford  Research  Institute 
under  contract  to  the  National. Institute  of  Education  (NIE),  Earlier 
reports  and  working  papers  produced  as  part  of  this  study  include:  . 

•  0,  W,  Markley,  "The  Normative  Structure  of  Knowledge 
Production  and  Utilization:     Interim  Report"  (December 
1974), 

•  T,  Mandel,  "Development  and  Application  of  the  Analyti- 
cal^ Framework"  (December  1974), 

•  R,  Prewitt,  "Functional  Subsystems  for  Curriculum  Re- 
form" (December  1974), 

•  A,  Zink,  "Use  of  Mind  or  Behavior  Modifying  Techniques 
in  Education"  (December  1974), 

The  central  objective  of  the  study  was  to  develop  an  analytical  frame- 
work for  describing  the  governance  system  that  influences  knowledge  pro- 
duction and  utilization  (KPU)  activities  in  education.     In  the  first 
volume  we  describe  the  analytical  framework,  explain  how  it  was  developed, 
and  discuss  its  implications  for  a  research  and  development  (R6tD)  monitor- 
ing program. 

This  volume  demonstrates  the  use  of  the  analytic  framework  and  de- 
scribes the  substantive  findings  that  resulted  when  the  framework  was  ap- 
plied to  ten  different  case  study  topics. 

This  study  is  one  of  a  series  sponsored  by  NIE' s  R&D  Systems  Support 
Division  in  response  to  the  recommendations  of  exploratory  position  papers 
such  as  "Building  Capacity  for  Knowledge  Production  and  Utilization  in 
Education"  (Task  Force  on  Resources  Planning  and  Analy^^is,   1973)  and 
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"Modelling  a  National  Educational  R&D  System"  (Churchill,  1974).  Under 
the  direction  of  Dr.  Ward  Mason,  the  R&D  Systems  Support  Division  has  re- 
sponded to  NIE's  legislative  mandate  to  help  build  an  effective  R&D  system 
in  education  by  pursuing  three  interrelated  goals: 

1.  To  develop  a  monitoring  system  that  will  lead  to  a  sys- 
tematic data  base  concerning  educational  knowledge  pro- 
duction and  utilization. 

2.  To  initiate  a  series  of  studies  that  will: 

a.  Develop  models  of  the  educational  KPU  process  that 
lead  to  a  greater  understanding  of  applied  system 
dynamics; 

b.  Assess  the  status  of  the  R&D  system,  the  educational 
system,  and  the  changes  occurring  in  those  systems; 

c.  Identify  problems  and  areas  of  weakness  or  imbalance 
in  the  educational  KPU  system  for  which  NIE  support 
activities  are  needed; 

d.  Be  useful  to  NIE  policjmiakers,  to  the  R&D  and  edu- 
cational communities,  and  to  the  general  public. 

3.  To  design  and  manage  specific  programs  for  strengthening 
the  educational  KPU  system. 

Related  investigations  supported  by  the  R&D  Systems  Support  Division 
include: 

•  William  Paisley  and  associates  at  Stanford  University,  pre- 
paring the  first  two  editions  of  a  Databook  and  a  separate 
technical  report  in  which  they  will  analyze  existing  data 
bases  and  make  recommendations  for  the  development  of  a  more 
coherent  system  of  statistical  indicators  regarding  the 
status  of  KPU  in  education. 

•  Rolf  Lemming  at  NIE,  conducting  a  survey  of  various  insti- 
tutional performers  of  KPU  in  education. 

•  Michael  Radnor  at  Northwestern  University,  studying  R&D  sys- 
tems in  such  areas  as  agriculture,  aerospace,  and  defense  to 
deduce  applicable  principles  for  R&D  management  in  educa- 
tion. 
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•    David  Clark  and  Egon  Guba  at  Indiana  University,  studying 
the  KPU- related  roles  of  departments,   schools,   and  colleges 
of  education. 

These  studies  constitute  a  set  of  preliminary  "predesign"  studies 
that  should  illuminate  the  actual  design  of  a  monitoring  system  at  a  later 
date. 
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GLOSSARY 


Agent 

Analytic  framework 
Conceptual  subsystems 
Configuration 

Field  of  analysis 
Focus  of  analysis 
•  Functional  subsystems 

Infrastructure 

KPU 


A  legally  responsible  entity,  one  or  more  persons 
concerned  with  any  phase  of  the  KPU  system,  in- 
cluding individuals,  teams  of  persons,  and 
institutions  that  act  in  a  relatively  unitary 
fashion.     The  terms  agency  and  actor  may  also  be 
used  where  convenient  to  distinguish  the  institu- 
tion from  the  institution's  representative  person. 

A  conceptual  structure  that  guides  inquiry  into 
and  analysis  of  KPU  in  education. 

Subsystems  that  follow  from  a  particular  way  of 
conceptualizing  the  system  under  study. 

An  image  or  description  of  a  portion  (or  a  whole) 
of  the  KPU  infrastructure  as  developed  from  a 
particular  perspective.    A  configuration  is-  an 
arrangement  of  a  set  of  features  and  distinctions 
made  by  an  analyst  who  guides  his  inquiry  with  a 
particular  purpose. 

The  environment  and  ecology  of  the  focus  of  analy- 
sis. 

The  agents,  activities,  policies,  and  resources  of 
central  concern  to  a  specific  purpose  of  analysis. 

Subsystems  that  emerge  empirically  to  accomj)lish  a 
particular  function  in  the  larger  system  under  ^ 
study. 

The  interrelated  elements  through  which  the  process 
of  knowledge  production  and  utilization  in  education 
takes  place. 

The  sum  of  innovative  activities  ranging  from  basic 
research  to  installation  of  new  practices  through 
which  new  knowledge  is  produced  and  used  in  educa- 
tion.    The  term  is  broader  than  simply  research  and 
development,  incorporating  as  well  the  linkage  of 
the  research  and  development  activities  and  the 
utilization  of  their  products.     Such  activities  as 
evaluation,  demonstration,  disseminatioiT,  diffusion, 
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policy  studies,  or  policy  research  are  to  be  con- 
sidered as  components  of  the  four  basic  KPU  ac- 
tivity categories  of  research,  development,  linkage, 
and  utilization. 

Normative  structure       The  set  of  values  and  principles  (both  formal  poli- 
cies and  informal  norms)  that  guide  behavior  con- 
cerned with  the  production,  dissemination,  and 
utilization  of  educational  knowledge. 

Purposive  activities      A  set  of  actions  that  reflect  or  build  toward  the 

intent  of  some  formal  statement  of  goals  or  norms, 
or  what  we  call  formal  policy.  (See  goal  oriented 
activity.) 

Resources  The  matter,  energy,  and  information  needed  to  engage 

in  a  particular  activity.     Resources  consumed  and/or 
transformed  by  agents  into  other  resources  include 
money,  educational  products,  information,  individual 
skills,  and  the  like. 


In  our  discussion  of  Phase  2  of  the  project  we  abandoned  a  number  of 
terms  used  in  our  discussion  of  Phase  1.     We  did  this  for  the  following 
reasons:     either  we  could  replace  them  with  new  terms  that  more  closely 
describe  the  concept;  or  we  did  not  mention  the  concept  itself  in  our 
discussion  of  Phase  2. 

To  assist  the  reader  in  understanding  the  discussion  of  Phase  1  we 
list  and  explain  these  abandoned  terms  below.     The  terms  have  been  segre- 
gated from  the  rest  of  the  glossary  to  emphasize  the  fact  that  they  have 
been  abandoned  or  replaced  by  new  terminology  in  the  discussion  of  Phase 
2  of  the  project. 

Flow  The  movement  of  resources  and  influences  through 

the  EKPU  system. 

Goal  oriented  Activity  evaluated  against  and  modified  to  serve 

Activity  some  intent.     (See  purposive  activity.) 

Process  loop  A  prescribed  and  time-sequenced  series  of  actions 

incorporating  planning  and  evaluation  and  directed 
toward  the  accomplishment  of  an  objective. 
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Public  Policy  Directives  that  are  codified  and  have  a  legal  basis. 

Regulators  (PPRs)  Examples  include  statutory  law,  codes  of  ethics, 

certification  evaluation  and  planning  requirements, 
formal  incentives,  and  budgetary  priorities.  Ex- 
cluded from  this  subset  are  informal  norms,  unwrit- 
ten procedural  conventions,  and  the  observe;d 
behavior  patterns  of  regulatory  agents. 

Regulators  The  various  norms,  rules,  laws,  procedural^  conven- 

tions, and  observed  behavioral  patterns  of 
regulatory  agents  that  constitute  the  normative 
structure  of  the  KPU  system. 

Regulatory  agent  An  agent  responsible  for  establishing,  changing, 

or  implementing  one  regulator  or  a  set  of  regu- 
lators. 


xiii 


SUMMARY 


This  project  is  one  of  several  predesign  studies  commissioned  by  the 
National  Institute  of  Education's  R&D  System  Support  Program  to  help  the 
Institute  establish  design  requirements  for  an  external  monitoring  system 
it  has  proposed  to  develop.     The  pursuit  of  such  a  monitoring  capability 
is  in  direct  response  to  NIE's  congressionally  bestowed  mission  to  "help 
build  an  effective  R&D  system"  as  well  as  its  own  recognition  that  "there 
is  a  great  need  for  better  data  concerning  the  knowledge  production  and 
utilization  system  and  the  operating  school  system  it  serves  .... 
Generally  we  have  lacked  both  the  data  base  and  the  understanding  of 
system  dynamics  needed  for  effective,  rational  policy-making."    This  use 
of  the  term  knowledge  production  and  utilization  (KPU)  stems  from  the 
Institute's  recognition  that  research  and  development  is  a  misleadingly 
narrow  term  to  apply  to  improvement-oriented  change  'activities  in  education 
and  that  a  more  encompassing  conception  is  needed  to  adequately  legitimize 
the  full  range  of  activities  necessary  to  help  solve  or  to  alleviate  the 
problems  of  American  education. 

The  central  objectives  of  this  study  were  to  investigate  the  "noma- 
tive  structure"   (the  governance  system)  of  KPU;  develop  an  analytical 
framework  through  which  to  understand  how  formal  policy  acts  as  a  "regu- 
lator" of  activities  in  KPU;  describe  the  major  policies  of  significance 
to  KPU  and  how  they  influence  the  governance  of  KPU  processes  in  ten 
different, case  studies  selected  to       widely  representative  of  KPU  in 
education;  and  make  recommendations  that  would  help  in  the  design  of  a 
monitoring  program.    As  a  whole,  the  effort  was  conceived  of  as  an 
exploratory  attempt  to  develop  and  test  the  feasibility  of  a  systems 
mapping  approach  believed  to  be  compatible  with  the  concepts  that  NIE 
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proposed  for  use  in  its  monitoring  program.    As  with  many  systems  studies, 
the  study  was  designed  in  a  recursive  fashion,  where  the  results  of  an 
initial  period  of  inquiry  were  assessed  and  the  study  design  was  reformu- 
lated before  proceeding  further. 

In  our  first  approach,  we  sought  to: 

•  Construct  an  extensive  taxonomy  through  which  all  major 
types  of  agents,  policies,  flows,  and  several  other 
regulatory  influences  on  KPU  could  be  classified  and 
assigned  a  code  for  indexing  purposes, 

•  Develop  a  basic  master  system  map  (to  provide  consis- 
tency and  coherence  as  detailed  maps  of  KPU  subsystems 
were  developed)  showing  all  major  agents  and  on  which 
all  major  information,  product,  and  resource  flows 
could  be  depicted. 

•  Apply  a  variety  of  commonly  used  systems  analysis  tools 
and  techniques  in  concert  with  the  maps,  the  taxonomy, 
and  other  information  in  such  sources  as  ERIC  and  the 
Databook  being  prepared  in  a  parallel  study  to  describe 
KPU  phenomena  in  a  way  that  would  integrate  four  different 
modes  of  description: 

-  Typological--a  multidimensional  classification  of 
agents,  policies,  flows,  and  other  aspects  of  KPU  in 
education  and  its  governance  structure. 

-  Graphical --a  series  of  diagrams  that  reveal  the  static 
and  dynamic  relationships*  of  various  KPU  system 
elements. 

-  Numerical--time-series  and  other  indicators  that 
express  the  quantified  attributes  of  the  system  and 
its  parts. 

-  Textual --verbal  descriptions  of  research  findings, 
lav*^,  guidelines,  and  other  information  that  expresses 

:    noii^uantified  and  non-imagistic  attributes  of  the 
system  and  its  parts. 

Because  of  the  emphasis  on  the  role  of  formal  policies  which  help  reg- 
ulate or  govern  KPU,  and  on  the  role  that  time-series  indicators  might  have 
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in  monitoring  KPU,  the  conceptual  image  or  paradigm  initially  explored 
could  be  characterized  as  essentially  that  of  hierarchical  systems. 

Regardless  of  how  one  might  view  the  desirability  of  its  attributes, 
this  approach  was  found  to  be  unfeasible  as  a  framework  for  investigation 
and  analysis  of  KPU  in  education.     KPU  is  a  secondary  goal  for  most  agents 
and  institutions  in  the  KPU  infrastructure;  hence. the  involvement  of  many 
of. these  agents  and  institutions  is  ad  hoc  or  purpose  specific.  Unless 
one  first  specifies  fairly  precisely  what  it  is  one  wants  to  know  about 
the  KPU  infrastructure,  efforts  to  map  KPU  as  a  system  with  various  sub- 
systems must  be  done  either  at  such  a  high  level  of  abstraction  that  the 
level  of  detail  is  inadequate  for  realistic  analysis  or  at  such  a  high 
level  of  concrete  detail  that  the  portrayal  falls  down  under  its  own 
weight,  given  the  limitations  of  available  media.    Moreover,  there  is 
not  merely  one  perspective  from  which  to  map  KPU,  but  many,  each  of  which 
illuminates  a  different  set  of  relationships  underlying  KPU  phenomena. 

We  therefore  revised  our  basic  strategy  and  relied  on  our  inquiry 
in  the  ten  case  topics  to  guide  the  development  of  a  framework  that  could 
be  used  to  describe  various  aspects  of  KPU  as  seen  from  various  perspec- 
tives and  for  various  purposes,  rather  than  to  test  the  feasibility  of 
one  that  would  fit  any  given  part  of  KPU  into  an  overall  general  map  of 
hierarchically  ordered  classifications.     Policies,  agents,  resources, 
and  activities  in  KPU  were  the  four  basic  terms  of  reference  that  we  used 
as  the  basic  building  blocks  in  this  new  pursuit.    As  requested  by  NIE, 
we  developed  a  finished  taxonomy  only  for  formal  policies. 

In  pursuing  this  strategy  we  developed  a  flexible  methodology  that 
allows  the  researcher  to  describe  the  interaction  of  various  configura- 
tions of  policies,  agents,  and  resources  in  the  shaping  of  activities 
through  which  specific  acts  or  processes  of  knowledge  production  and 
utilization  take  place.     The  methodology  allows  one  to  see  systemic 
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relationships  without  forcing  one  to  systematize  them  in  an  overly 
simplistic  fashion.     To  do  this  requires  that  the  purpose  of  analysis 
at  least  be  tentatively  established  by  the  analyst  to  provide  a  basis, 
on  which  to  make  distinctions  and  draw  connections  and  inferences.  (A 
first  distinction  the  analyst  makes,  for  example,  is  between  the  focus 
of  his  interest  and  its  surroundings.    A  second  distinction  concerns  the 
extent  to  which  relationships  involving  parts  of  a  given  configuration, 
the  configuration  itself,  or  the  environment  of  the  configuration  should 
be  explored.) 

From  the  results  of  our  exploratory  study,  we  judge  that  NIE's  stated 
objectives  for  its  monitoring  program  cannot  feasibly  be  fulfilled  by  a 
system  based  on  the  social  indicators  approach.    Although  this  approach 
is  particularly  suitable  for  improving  understanding  of  some  activities 
in  some  parts  of  the  KPU  infrastructure  (e.g.,  those  activities  having 
to  do  with  the  distribution  and  control  of  fiscal  resources  that  are 
highly  specified  by  fomal  policy),  it  is  particularly  unsuitable  for 
improving  understanding  of  others  (e.g.,  those  activities  relating  to 
the  actual  creation  and  use  of  new  knowledge  that  are  highly  discretionary 
in  nature) . 

A  variety  of  recommendations  for  development  of  the  monitoring 
program  were  inferred  from  the  findings  of  the  project. 

•  NIE  should  consider  and  include  a  variety  of  conceptual 
viewpoints  in  the  design  of  its  monitoring  program. 

•  The  design  of  the  monitoring  program  should  be  based,  in 
part,  on  an  explicit  consideration  of  such  definitive 
issues  as: 

-  The  degree  to  which  NIE's  monitoring  program  will  be 
based  on  any  given  conceptualization  or  pairadigin  as 
opposed  to  being  based  on  a  deliberate  or  haphazard 
mixture  of  conceptual  approaches. 
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-  The  degree  to  which  NI£  will  try  to  rigorously  articulate 
(i.e.,  codesign  and  coordinate)  its  monitoring  program 
and  its  other  governance  functions. 

-  The  degree  to  xvhich  new  knowledge  will  be  conceptually 
limited  to  include  only  that  which  results  from  processes 
and/or  products  of  the  institutionalized  KPU  system, 

-  The  degree  to  which  data  needs  and  data  collection  ac- 
tivities of  other  agencies  (particularly  at  the  state 
level)  will  be  explicitly  considered  in  the  design  of 
the  monitoring  program, 

•  The  design  of  a  monitoring  program  should,  in  large  part, 
be  based  on  the  types  of  infomation  about  the  KPU  infra- 
structure that  will  actually  be  needed  by  major  policy 
analysis  activities  anticipated  for  the  next  several 
years.     Thus  a  policy  analysis  information-needs  assess- 
ment should  be  done  as  an  additional  "predesign"  study. 

•  The  assessment  of  likely  impacts  of  the  Buckley  Amendment 
on  KPU  is  an  immediate  activity  that  well-represents  a 
type  of  policy  analysis  that  will  increasingly  need  infor- 
mation about  the  infrastructure  of  KPU  in  the  future  and 
should  be  undertaken  both  for  its  own  sake  and  as  a  way 

of  concretely  facing  various  trade-offs  in  the  design  of 
the  monitoring  program. 

•  As  a  first  step  in  the  development  of  time-series  indicators 
of  balance  and  continuity  of  support  in  KPU  (as  well  as  to 
provide  information  of  vital  interest  to  NIE ' s  constituency) , 
NIE  should  prepare  cross-tabulations  of  its  disbursements 

in  various  categories  (such  as  mode  of  procurement,  sub- 
stantive topic,  type  of  performer)  for  inclusion  in  subsequent 
editions  of  its  Databook. 

The  final  report  of  this  study  comprises  two  volumes,  the  first  of 
which  describes  the  conduct  of  the  study  as  a  whole,  the  methodological 
framework  that  was  developed,  and  the  recommendations  that  were  inferred. 
This  volume  also  contains  an  annotated  bibliography  of  various  topics 
covered  by  the  study.     The  second  volume  demonstrates  the  use  of  the 
framework  and  describes  the  substantive  findings  that  resulted  when  the 
framework  was  applied  to  the  following  ten  casei  topics: 
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National  Institute  of  Education  (NIE)  Allocation 
Policy 

Federal  Procurement  Policy  and  Knowledge  Production 
and  Utilization  in  Education 

Assessing  the  Impact  of  Policies  that  Control  the 
Availability  of  Information 

The  Far  West  Laboratory  as  a  Research  and 
Development  Performer 

Minicourses  as  an  Example  of  Policies  Affecting  the 
Dissemination/LJtilization  of  a  Successful  R&D 
Product 

The  School  Mathematics  Study  Group  (SMSG)  Project 

as  an  Example  of  Policies  Affecting  the  Dissemination/ 

Utilization  of  an  R&D  Product 

ESEA  Title  III  Teacher  Initiated  Innovation  Program: 
An  Example  of  Policies  Interfacing  Levels  of  Government 

The  Governance  of  Knowledge  Production  and  Utilization 
in  Intermediate  Service  Agencies:     Boards  of  Cooperative 
Educational  Services  in  Colorado  and  New  York 

Policies  Affecting  the  Results  of  the  Federally 
Sponsored  Pilot  State  Dissemination  Program  in  South 
Carolina:  1970-73 

An  Approach  to  Monitoring  the  Role  of  Government 
Policies  in  the  Process  for  Selection  and  Evaluation 
of  New  Instructional  Materials 
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I  BACKGROUND 

Because  there  is  no  direct  constitutional  basis  for  federal  involve- 
ment in  education,  the  U.S.  government  for  many  years  took  only  an  inactive 
role  in  educational  affairs.     For  example,  the  U.S.  Office  of  Education 
(USOE),  which  was  established  in  1867,  was  to  "collect  statistics  and  facts 
showing  the  condition  and  progress  of  education  in  the  several  states  and 
territories"  (Levien,   1971).     The  essentially  passive  posture  of  the  U.S. 
government  with  regard  to  educational  knowledge  production  and  utilization 
(EKPU)  remained  unchanged  until,  among  other  things,   the  advent  of  Sputnik 
jolted  Congressional  leaders  into  a  reaction  of  alarm.     A  spate  of  legis- 
lative initiatives,  starting  with  the  Cooperative  Research  Act  of  1954 
(PL  83-531,  amended  by  PL  89-10,   89-750,  and  90-247),   soon  made  educational 
R6cD  a  priority  area  for  federal  support — rationalized  on  the  basis  ♦of  na- 
tional  need. 

Background 

As  a  result  of  such  legislation,  the  federal  government  has  become 
the  single  largest  source  of  financial  support  for  education  research  and 
development.     By  1970,  when  the  federal  government  underwrote  56%  of  the 


Other  legislation  that  significantly  added  to  the  federal  government's 
support  of  educational  R&D  during  this  period  includes  Titles  III  and  V 
of  the  Mental  Retardation  Facilities  and  Connnunity  Mental  Health  Centers 
Construction  Act  of  1963  (PL  85-926,  amended  by  PL  88-164),  the  Vocational 
.Education  Act  (PL  88-210,  amended  by  PL  90-576),  Title  VI  of  the  National 
Defense  Education  Act  (PL  85-864),  Titles 'ill,  IV,  and  V  of  the  Elementary 
and  Secondary  Education  Act  (ESEA)  of  1965  (PL  89-10),  and  the  Education 
Amendments  of  1972  (PL  92-318)  and  1974  (PL  93-380). 
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nation's  total  R&D  effort  (industry  providing  about  39%),  it  provided  ap- 
proximately 85%  of  the  financial  support  for  education  R&D  (National  Insti- 
tute of  Education,  1975).*    By  1972,  it  was  apparent  that  the  nation's 
education  R&D  needs  could  not  reasonably  be  met  by  an  agency  having  as  many 
operational  responsibilities  as  the  U.S.  Office  of  Education.     For  this 
reason,  and  others,   the  National  Institute  of  Education  was  established 
as  the  federal  agency  responsible  for  educational  research  and  experimen- 
tation. 

Federal  policies  relative  to  R&D  allocations  are  of  major  importance 
to  the  EKPU  system.     The  importance  of  federal  support  appears  all  the 
more  significant  in  light  of:     the  perception  that  education  R&D  is  sig- 
nificantly underfunded  relative  to  the  proportion  of  funds  going  to  re- 
search in  other  sectors,   such  as  agriculture,  medicine,  and  defense 
(Gideonse,   1970);  the  expectation  set  in  motion  by  President  Nixon's  Mes- 
sage on  Educational  Reform  envisioning  a  mature  National  Institute  of 
Education  being  funded  at  perhaps  a  quarter  of  a  billion  dollars;  and  the 
fact  that,  contrary  to  expectations,  NIE's  annual  allocations  have  de- 
creased rather  than  increased  over  time. 

The  purpose  of  this  case  topic  is  to  inquire  into  the  nature  of  NIE 
allocations  policy  since  1972.  By  "allocations  policy"  is  meant  those 
decisions,  guidelines,  rules,  and  so  forth  that  determine  the  amounts  and 
purposes  of  funds  that  NIE  receives  and  in  turn  obligates.  To  the  extent 
that  other  terms  such  as  authorization,  appropriation,  apportionment,  al- 
lotment, and  allowance  share  in  this  definition,  they  are  included  in  the 
allocations  policy  framework. 


A  list  of  references  is  appended  to  this  case  study. 
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II  INTRODUCTION 


This  case  study  has  been  organized  to  help  the  reader  understand  how 
the  mapping  paradigm  we  have  developed  actually  works.     First,  we  present 
the  description  of  NIE  allocations  policy  that  resulted  from  the  analysis, 
and  then  we  turn  to  a  step-by- step  application  of  the  paradigm  that  pro- 
duced this  description.     Those  who  are  interested  only  in. the  substantive^ 
results  of  this  analysis  should  turn  immediately  to  Section  IV  (p.   19)  of 
this  report. 

The  analysis  starts  with  the  brief  work  statement  shown  as  Table  I-l. 
Such  a  statement  was  prepared  for  each  of  the  ten  case  topics  of  this 
study,  as  a  way  of  focusing  and  translating  the  requirements  of  various 
documents  (e.g.,   the  request  for  proposal,  the  proposal,  and  memoranda 
between  SRI  and  NIE  modifying  the  statement  of  work),   thus  providing  the 
research  analyst  with  a  clear  starting  point.     In  keeping  with  the  re- 
cursive nature  of  the  approach,  however,   it  was  expected  that  the  proce- 
dures specified  by  these  work  statements  would  be  somewhat  modifed  as  the 
work  proceeded. 
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Table  I-l 
CASE  STUDY  WORK  STATEMENT 


(a)    Topic  I;     NIE  Allocation  Policy 
(Agent- Centered,   Semi- Complex) 

The  identification  of  all  significant  policies  that  determine  how  NIE 
allocates  its  funds  is  a  topic  that  is  of  expressed  interest  to  NIE 
and  that  tests  the  framework's  ability  to  portray  coherently  the  ar- 
ray of  policies  that  act  on  a  given-  agent. 

Step  1— Identify  all  published  policies  that  mandate,  authorize,  or 
recommend  specific  areas  in  which  NIE  should  allocate  its  resources. 
Do  not  include  testimony  at  Congressional  hearings  or  internal  memo- 
randa, other  than  noting  that  these  influences  also  exist. 

Step  2--Categorize  the  policies,  using  the  taxonomy,  breaking  out  in- 
ternal NIE  structure  only  to  the  extent  necessary  by  virtue  of  con- 
tent explicitly  contained  in  the  policies. 

Step  3 — On  the  basis  of  our  analysis  and  conversations  with  NIE  per- 
sonnel, recommend  further  work  in  this  general  area  (e.g.,  mapping  of 
policies  that  influence  the  activities  of  a  key  KPU  agency,  either 
federal  or  state),  designing  one  or  more  specific  projects  as  seems 
appropriate. 


(b)  Outputs 

An  assessment  (strengths  and  weaknesses)  of  the  analytical  framework 
as  used  in  this  topic,  and  as  might  be  used  to  structure  an  informa- 
tion system  containing  agency-specific  policies. 

A  structured  presentation  (and  supporting  documentation)  of  the  poli- 
cies with  which  NIE  is  supposed  to  comply  and  that  determine  its  al- 
location policy. 

Any  recommended  further  work  that  seems  appropriate. 
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Ill    STEP-BY-STEP  INQUIRY 


In  this  section,  at  each  step  in  the  analytical  approach,  we  will: 

•  Repeat  the  instructions  prescribed  by  the  analytical  ap- 
proach. 

•  Briefly  describe  the  actions  that  were  necessary  to  com- 
plete the  step, 

•  Document  the  information  that  resulted. 

Step  One--Select  and  write  the  purpose(s)  of  the  analysis  or 
inquiry  for  which  the  analytical  framework  is  to  be  used.  The 
statement  of  purpose  is  crucial  as  it  sets  up  the  heuristic 
decision  rules  for  using  the  framework;  it  must  be  refined, 
however,  as  subsequent  steps  are  taken. 

Initially,  'the  purpose  of  this  case  study  was  as  indicated  in  Ta- 
ble I-l — the  portrayal  of  policies  that  mandate,  authorize,  or  recommend 
specific  areas  to  which  NIE  should  allocate  its  resources.     As  the  various 
steps  specified  by  the  analytical  approach  were  tested,  however,  it  was 
discovered  that  in  general  two  types  of  purposes  needed  to  be  specified 
and,   for  this  particular  study,  three  types  were  needed.     These  were: 

(1)  substantive-- the  type  of  knowledge  to  be  produced  by  the  analysis; 

(2)  intended  utility-- the  type  of  application  that  would  use  the  knowl- 
edge specified  in  (1);  and  (3)  evaluate/test  (for  our  study  only)— the 
way  in  which  the  case  write-up  was  to  be  used  for  purposes  of  testing  the 
analytical  approach. 

The  purposes  set  forth  for  this  case  study  are  shown  in  Table  1-2, 

Step  Two--Tentatively  identify  the  focus  of  analysis,  e,g.,  a 
given  agent,  policy,  activity,  resource,  problem,  or  issue  (the 
target  of  the  first  step  above)  and  the  field  of  analysis^  e,g,, 
the  set  of  agents,  activities,  and  policies  that  will  be  con- 
sidered as  the  context  within  which  analysis  will  be  done, 
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Table  1-2 
INITIAL  PURPOSES  OF  CASE  STUDY 


Substantive  results 
to  be  produced 

To  identify  those  policies  that  most  signifi- 
cantly influence  the  amount  and  purpose  of  NIE 
allocations  and,  to  the  extent  deemed  appropri- 
ate, to  show  how  these  policies  interact. 

Intended  utility  of 
this  kind  of  anal- 
ysis 

To  provide  various  stakeholders  in  the  EKPU  sys- 
tem a  better  understanding  of  how  the  allocations 
system  works,  what  its  impacts  on  KPU  are,  and 
how  it  might  be  constructively  influenced. 

Evaluation  and  test 
of  the  analytic 
framework 

To  illustrate/test  hov?  the  approach  can  be  used 
to  portray  global  policies  (each  of  which  con- 
tains detailed  information)  acting  on  and  through 
a  federal  agency  having  a  central  responsibility 
for  supporting  EKPU, 

The  initial  focus  of  this  analysis  was  taken  to  be  NIE  as  an  agency 
that  sets,  enforces,  and  complies  with  various  allocations  policies;  that 
is,  the  emphasis  was  on  the  categories  and  the  amounts  of  funds  disbursed 
to  and  by  NIE  in  various  fiscal  years.    The  initial  field  of  analysis  was 
taken  to  be  all  elements  having  as  a  central  function  the  setting  of,  en- 
forcing of,  and  complying  with  policies  that  influence  NIE  allocations. 
This  field  was  initially  thought  to  include  principally  the  relevant  Con- 
gressional committees,   the  Office  of  Management  and  Budget  (0MB),  the  Of- 
fice of  the  Secretary  of  HEW,  the  National  Council  on  Educational  Research 
(NCER),  and  the  Director  and  internal  staff  of  NIE. 

Step  Three-"Identify  the  elements,  i.e.,  the  agents,  policies, 
resources,  and  activities,  making  up  the  focus  of  analysis;  re- 
late them  to  other  elements  in  the  field  to  establish  tentative 
relationships  between  and  among  them,  e.g.,   (1)  the  aigents  re- 
sponsible for  activities  through  policy  setting,  enforcing,  and 
complying  and  (2)  the  sequencing  of  activities  in  time.  V^^^ 
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It  is  difficult  to  distinguish  clearly  between  the  elements  making 
up  the  field  and  the  focus  of  analysis  because  in  this  case  study  ^the  main 
topic--allocations— is  the  end  result  of  various  activities.    However,  it 
is  not  necessary  to  do  so.    The  purpose  of  this  step  is  the  identification 
of  all  the  elements  needing  to  be  considered.     Tentatively  giving  higher 
priority  to  elements  in  the  focus,  lower  priority  to  those  in  the  field, 
and  little  priority  to  those  outside  the  field  is  but  a  way  to  expedite 
this  process. 

In  searching  out  the  elements  (agents,  policies,  resources,  and  ac- 
tivities) making  up  the  focus  of  analysis,  we  looked  first  at  policies. 
It  soon  became  apparent  that  the  "agent- centered''  orientation  originally 
assigned  to  the  study  was  inappropriate.     An  agency- centered  approach 
would  lead  to  a  focusing  on  the  e^lements  that  influence  NIE  as  a  policy- 
making agency  relative  to  allocations.     At  that  time,  however,  the  spe- 
cific focus  of  this  case  study  was  seen  as  those  elements  that  influence 
the  allocations  themselves.     The  difference  may  seem  a  small  one,  but  it 
had  significance  when  ordering  a  variety  of  elements  into  some  kind  of 
analytical  framework. 

Table  1-3  typifies  the  listing  of  elements  (in  this  instance,  poli- 
cies) that  were  collected  .at  this  stage.     Based  on  this  step,  we  then 
identified  what  appeared  to  be  the  single  most  significant  elements  in 
the  allocations  process. 

Two  policies  appear  most  significant.     The  first  is  the  law  (PL 
92-318)  mandating  that  NIE  be  established,  and  authorizing  it  to  receive 
up  to  $550  million  during  the  first  three  years  of  operation.    The  Con- 
gress intended  that  the  essential  purposes  of  the  Institute  should  be: 

•  To  help  solve  or  to  alleviate  the  problems  of,  and  promote 
the  reform  and  renewal  of,  American  education. 

•  To  advance  the  practice  of  education  as  an  art,  a  science, 
and  a  profession. 
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Table  1-3 

PROVISIONAL  LIST  OF  POLICIES  INFLUENCING  NIE  ALLOCATIONS 


Reference  Citation 

Summary  of  Policy 

PL  92-318 
Section  405 
June  23,  1972 

Authorization:    Provided  $550  million  for  period  beginning  July  1, 
1972,  and  ending  June  30,  1975,  to  carry  out  the  functions  of  the 
Institute. 

Intent  of  Congress:     To  provide  every  person  an  equal  opportunity 
to  receive  an  education  of  quality,  regardless  of  race  and  so  on,  ' 
by  providing  leadership  in  the  conduct  and  support  of  scientific 
inquiry  into  the  educational  process. 

Substantive  missions  (Congress):     To  help  solve  the  problems  of, 
and  achieve  the  objectives  of,  American  education;  advance  the 
practice  of  education  as  an  art,  a  science,  and  a  profession; 
strengthen  the  scientific  and  technological  foundations  of  educa- 
tion; and  build  an  effective  R&D  system. 

NCER:     Established  NCER  to  help  carry  out  policies  of  intent  and  to 
establish  general  policies  for,  and  review  conduct  of,  NIE. 

To  carry  out  objectives  set  by  Congress,  the  Director  OF  NIE  is 
authorized  to:     conduct  educational  research;  collect  and  dissemi- 
nate educational  research;  train  individuals  in  educational  re- 
search; assist  and  foster  research  collection,  dissemination,  or 
training  through  grants  or  technical  assistance,  contracts  with 
institutions,  and  the  like;  promote  the  coordination  of  research 
within  the  federal  government;  and  provide. or  construct  facilities 
that  may  be  required  to  accomplish  such  purposes. 

Expenditures:    Not  less  than  907.-.  of  the  funds  appropriated  for  any 
fiscal  year  must  be  expended  through  outside  grants  and  contracts. 

Director  of  NIE:     Authorized  to  make,  promulgate,  issue,  rescind, 
and  amend  rules  and  regulations  governing  the  manner  of  operation 
of  the  Institute. 

Projects  funded  by  several  federal  agencies:    NIE  may  act  for  all 
in  administering  the  funds  advanced  for  a  single  project  by  more 
than  one  federal  agency. 

FY  1977  NIE 
planning  guidance 
for  FY  1977  plans 
(NIE  internal 
memorandum) 

Planning  policies:     Carry  out  dissemination  responsibilities;  main- 
.tain  joint  support  with  state  and  federal  agencies;  ensure  that 
state  and  local  education  agencies  receive  a  substantial  share  of 
Institute  funds;  address  the  needs  identified  by  Congress,  educa- 
tors^ researchers,  iand  state  and  local  policymakers;  and  coordinate 
activities  with  other  federal  agencies.  . 

NCER  Resolution 
No.  071073-1 
July  1973 

Resolution  on  inseparability  of  Council's  operational  and  advisory 
functions. 

NCER  Resolution 
No.  071073-2  • 
July  10,  1973 

Resolution  on  authority  of  the  Director  with  respect  to  supporting 
authorities  from  July  to  October  of  1973.    Allocate  funds  for  un*- 
solicited  proposais  and  conduct  exploratory  studies. 

Table  1-3  (Continued) 


Reference  Citation 

Summary  of  Policy 

NCER  Resolution 
No.  080673-3 
August  6,  1973 

Resolution  on  Research  Grants  Program:     Recommended  allocations  of 
107o  to  15*/.  of  Institute  resources  for  this  program. 

NCER  Resolution 
No.  091773-4 
September  1973 

Resolution  on  Allocation  of  Resources:     No  individual  grant  or  con- 
tract for  new  initiatives  with  an  annual  cost^^over  $500,000  or  a 
lifetime  cost  over  $2  million  will  be  approved  without  referral  to 
the  Council  for  consideration  of  the  policy  questions  that  any  such 
grants  or  contract  might  raise;  there  will  be  continuation  of 
transferred  programs  from  other  agencies;  37.  to  57.  of  the  alloca- 
tions will  be  available  for  unsolicited  proposals;  exploratory 
studies  will  be  conducted. 

NCER  Resolution 
No.  091773-5 
September  1973 

Approved  continuation  of  the  Education  Voucher  program  after  the 
Secretary  of  HEW  assigned  responsibility  of  the  Voucher  Program  to 
NIE. 

NCEF  Resolution 
No.  110573-6 
November  15^  1973 

Suspended  resolutions  on  the  Research  Grants  Program,  Allocation  of 
Resources,  and  Education  Voucher  Program  because  of  the  current 
funding  status  of  NIE. 

NCER  Resolution 
No.  120373-7 
December  1973 

Resolution  on  setting  priorities  for  educational  R&D:     Decided  that 
NIE  should  move  into  new  areas  and  not  expend  the  available  1974 
funds  for  activities  transferred  to  NIE  from  USOE  or  the  Office  of 
Economic  Opportunity  (GEO).    Therefore,  NIE  should  defer  the  obli- 
gation of  as  much  of  the  funding  commitments  as  possible,  where 
such  would  not  entail  undue  hardship  for  performers  and  would  not 
harm  the  research  objectives  or  potential  utility  of  the  activities 
concerned;  this  would  enable  NIE  to  initiate  work  on  new  priori- 
ties.    Wanted  the  commitment  level  to  be  reduced  from  $75  million 
to  about  $60  million.     Reactivated  resolution  No.  091773-5  to  con- 
tinue the  Education  Voucher  concept. 

NCER  Resolution 
No.  013074-8 
January  30,  1974 

Policy  of  NCER  to  hold  open  "public  meetings"  to  develop  better  un- 
derstanding of  NIE  policies  and  activities.     Enhance  public  aware- 
ness of  NIE  activities.     NIE  staff  members  to  solicit  public  opin- 
ion as  part  of  the  normal  program  planning  process. 

Section  414  of  the 
General  Education 
Provision  Act 
(PL  93-517) 

Automatic  extension  of  PL-93-380  through  June  30,  1976,  of  the  cur- 
rent authorization  in  the  event  that  work  leading  to  reauthoriza- 
tion has  not  been  completed.    The  automatic  extension  provision 
would  apply  to  current  authorizing  legislation,  GE PA  Part  A,  Sec- 
tion 405  as  amended,  which  provides  for  $550  million  for  the  three- 
year  period  beginning  FY  1973  and  ending  FY  1975.     Current  authori- 
zation (FY  1975)  is  $75  millioti. 

NCER  Resolution 
No.  013/749 
January  30,  1974 
(NIE  internal 
document) 

Member  of  the  NCER  will  participate  in  development  of  NlE^s  overall 
objectives  and  strategies  to  accomplish  the  goals  represehted  by 
the  1975  budget,  and  the  Council  will  review  and  approve  such  ob- 
jectives and  strategies  covering  each  area  of  Institute  activity 
in  forthcomijig  meetings,                                                    ;  . 
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Table  1-3  (Concluded) 


Reference  Citation 

Summary  of  Policy 

NCER  Resolution 
No.  011075-14 
January  10  1975 
(NIE  internal 
document) 

The  policy  goals  used  by  the  Council  in  reviewing  the  1976  budget 
may  also  be  used  by  NIE  in  1977  plans  (i.e.,   targeting. funds  to 
state  and  local  agencies,   competitive  processes,  public  involve- 
ment, and  programs  responsive  to  specific  needs  of  education). 

NCER  minutes 
May  1975 
(NIE  internal 
document) 

Agreed  that  the  Institute  should  strengthen  its  emphasis  on  eval- 
uation of  R&D  products  and  the  capacity  of  R&D  performing  institu- 
tions. 

NCER  minutes 
October  1974 

Ln  discussions  aimed  at  developing  a  reauthorization  strategy,  NCER 
identified  various  issues  to  be  addressed;  that  is,  that  NIE  must: 
identify  the  groups  that  have  expressed  interest  in  and  concern 
about  NIE  and  those  groups  to  acquaint  with  NIE;  identify  the  peo- 
ple within  the  groups  who  are  either  especially  significant  be-, 
cause  of  positions  or  especially  interested  in  education  and  edu- 
cational R&D;  find  out  from  them  their  views  on  what  NIE  should  be 
doing,  how  it  should  be  done,  and  means  of  making  programs  useful 
and  understandable  to  constituencies;  and  exchange  ideas  an^d  infor- 
mation to  inform  and  assist  the  development  of  legislation  and  pro- 
grams , 
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•  To  strengthen  the  scientific  and  technological  foundations 
of  education. 

•  To  build  an  effective  eduational  research  and  development 
system. 

The  second  is  the  law  whose  enactment  each  fiscal  year  sets  the  specific 
level  of  funds  that  NIE  shall  receive. 

After  looking  at  policies,  we  turned  to  the  relevant  activities,  re- 
sources,  and  agents.     The  primary  activity  is  the  budget  process,  which 
takes  place  under  the  new  Congressional  Budget  Act  (PL  93-344)  in  four 
interrelated  phases:     executive  formulation  and  transmittal.  Congressional 
authorization  and  appropriation,  budget  execution  control,  and  review  and 
audit.     The  primary  resource  is  the  funds  that  are  appropriated  by  the 
Congress,  apportioned  by  0MB,  and  allotted  to  specific  activity  areas 
within  NIE.    The  most  significant  agents  for  this  analysis  are  the  Con- 
gress, which  is  responsible  for  setting  the  overall  allocation  levels 
within  which  NIE  must  work,  and  NCER  (setup  by  Congress  as  a  primary  gov- 
erning body  for  NIE),  which  is  responsible  for  setting  the  specific  pri- 
orities of  the  NIE  budget  and  for  approving  all  major  policy  decisions 
made  by  NIE  officials. 

Step  Four--After  making  this  "first  cut"  at  the  significant 
elements,  construct  configurations  that  describe  the  system 
and  bow  it  works.     Try  alternative  levels  of  scope  using 
hierarchically-nested  fields  and  foci  of  analysis,  or  mul- 
tiple foci  within  one  field  of  analysis. 

Test  the  adequacy  of  these  configurations  against:     the  pur- 
chase (s)  of  analysis  (return  to  Step  One  and  clarify  the  pur- 
pose if  necessary);  the  empirical  evidence  (using  KPU  literature, 
legal  and  policy  archives,  interviews,  and  so  forth);  and  the 
analyst's  tentative  image  of  the  system  (part  of  which. is  the 
underlying  theory  or  model  with  which  the  analyst  thinks). 

Collect  additional  information  as  necessary,  refining  Steps 
Three  and  Four;  draw  desired  conclusions. 
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Before  describing  the  results  of  this  stage,  it  may  be  helpful  to 
state  some  important  methodological  considerations.     Unless  the  analyst 
knows  the  system  under  study  rather  well  and  knows  in  addition  the  pre- 
cise fashion  in  which  he  or  she  wishes  to  portray  this  system,  he  cannot 
judge  how  much  detail  to  include  in  his  portrayal  of  the  various  configur- 
ations of  elements  making  up  the  (sub) system  under  study.     Thus,  he  must 
try  levels  of  detail  that  are  both  greater  and  less  than  the  one  initially 
envisioned.     If  unfamiliar  with  the  general  topic  being  investigated,  the 
analyst  might  start  by  portraying  the  elements  in  ways  that  are  simple/ 
global,  and  then  gradually  work  into  increasing  levels  of  complexity/ de- 
tail.    Having  tried  varying  levels  of  complexity  and  abstraction,  he  should 
go  back  to  the  original  purpose  and  intended  scope  of  the  analysis,  and 
refine  or  modify  details  as  needed  to  make  the  inquiry  more  useful. 

Although  we  tried  several  representations  of  the  significant  elements 
in  NIE  allocations  policymaking,   it  proved  impossible  to  illustrate  ade- 
quately the  full  range  of  these  explorations.     The  primary  difficulty  is 
that  when  a  complex  and  abstract  set  of  ideas  does  not  *'work, "  such  ideas 
are  difficult  to  express  coherently  without  describing  as  well  the  process 
through  which  they  were  developed--which  cannot  be  done  economically  in  a 
report  of  this  type.     Therefore,  we  shall  not  describe  all  configurations 
tried,  but  will  simply  illustrate  with  a  few  examples. 

Figure  I-l  portrays  the  societal  context  in  which  NIE  allocations 
take  place  and  shows  the  ^principal  agents  at  a  high  level  of  abstraction, 
using  a  flowchart  that  helps  one  to  intuit  the  dynamic  interrelationships 
among  system  elements.     (A  similar  portrayal  was  attempted  at  lower  levels 
of  abstraction--e. g. ,   showing  the  appropriations  process  in  the  legislative 
branch  and  the  budget  formulation  process  in  the  executive  branch--but  it 
quickly  became  more  detailed  than  was  appropriate  for  this  task.  Hence, 
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we  decided  not  to  alter  the  originally  assigned — "simple" — scope  of  anal- 
ysis of  this  topic.) 

The  configuring  of  agents,  policies,  and  other  system  elements  in 
NIE  allocations  followed  along  lines  portrayed  by  Figures  1-2  and  1-3,  so 
that  all  relevent  policies  could  be  identified.     Various  ways  of  arranging 
allocations  policies  were  then  prepared  (see,   for  example.  Table  1-4), 
both  to  ge.t  a  dynamic  sense  of  the  changing  allocation  policies  across 
time,  and  as  an  experiment  to  see  if  similar  tables  could  usefully  be 
made  at  differing  levels  of  scope. 

Having  sufficiently  covered  the  available  literature,  and  having 
interviewed  various  persons  knowledgeable  about  NIE's  history  and  its 
allocations,  we  decided  that  to  do  more  than  use  the  analytical  frame- 
work to  document  the  most  significant  policies  influencing  NIE  allocations 
would  be  imprudent.     This  decision  was  made  for  three  reasons.  First, 
although  the  source  policies  governing  all  four  major  stages  in  the  bud- 
geting process  could  be  identified,  it  was  not  feasible  to  document  spe- 
cific activities  through  which  the  purposes  of  each  of  these  stages  are 
fulfilled.     The  recency  of  NIE  as  an  institution  and  its  early  chaotic 
fiscal  environment  have  prevented  a  well-documented  budgeting  system  from 
being  implemented  until  the  present  budgeting  cycle,  and  the  details  of 
these  procedures  are  not  yet  ready  for  external  documentation.  Second, 
the  Congressional  Budget  and  Impoundment  Control  Act  of  1974  (PL  93-344) 
has  too  recently  been  enacted  for  full  translation  into  operational  form 
at  all  levels  of  the  federal  bureaucracy.     Third,  both  the  appropriations 
hearings  and  studies  such  as  Sproull,  Wiener,  and  Wolf  (1975)  indicate 
that  the  significant  realities  shaping  NIE  allocations  during  its  first 
few  years  in  operation  continue  to  be  more .informal  than  formal. 

Step  Five — Complete  significant  portions  of  systems  maps  ac- 
cording to  the  initial  purpose  of  the  study,  highlighting 
interrelationships  among  elements  so  that  conclusions  are 
clearly  drawn  and  justified  as  the  final  response  to  the  data 
collected  in  previous  steps. 
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Rather  than  comment  here  on  the  choices  that  had  to  be  made  and  the 
difficulties  faced  at  this  step,  we  shall  turn  to  the  substantive  finding 
that  resulted  from  this  case  study:  (1)  a  description  of  NIE  allocations 
policy  in  a  "resource- centered,  simple"  mode,  and  (2)  recommendations  for 
further  studies  or  monitoring  activities  that  NIE  might  wish  to  support. 
Finally,  we  briefly  comment  on  the  adequacy  of  the  analytical  approach  in 
this  study. 
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IV    SUBSTANTIVE  RESULTS 


Creation  of  the  NIE 

Executive  Foinrtulation  and  Transmittal 

Although  there  were  a  number  of  antecedent  studies,  statements,  and 
recommendations  suggesting  a  National  Institute  or  Institutes  of  Education 
(Levien,  1971).,  President  Nixon*  s  (1970)  '^Message  on  Educational  Reform" 
was  the  first  instance  of  a  formal  policy  that  specified  specific  details 
regarding  what  would  become  NIE  allocations'policy.     This  message  char- 
aracterized  the  proposed  Institute  as  "a  focus  for  educational  research 
and  experimentation  in  the  United  States/'  detailed  the  need  for  and  the 
nature  of  such  a  national  agency,  and  indicated  six  topics  to  which  the 
Institute  would  be  expected  to  turn  its  attention.     This  first  listing 
of  priority  substantive  targets  of  need  included: 

•  New  measures  *of  achievement 

•  Compensatory  education 

•  The  right  to  read 

•  Television  and  learning 

•  Experimental  schools 

•  Early  learning. 

In  terms  of  anticipated  appropriation  of  funds  to  meet  these  needs, 
the  President  proposed  that  "When  fully  developed,  the  Institute  would  be 
an  important  element  in  the  nation's  educational  system,  overseeing  the 
annual  expenditure  of  as  much  as  a  quarter  of  a  billion  dollars," 
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Initial  Congressional  Authorization  and  Appropriation 

The  President's  message  coincided  with  HEW's  submission  of  proposed 
legislation  to  the  Congress.     After  much  debate  and  compromise  on  how  the 
NIE  and  the  newly  created  Division  of  Education  should  be  governed,  legis- 
lation was  passed  enabling  HEW  to  create  the  NIE  and  authorizing  the  ap- 
propriation of  funds  to  meet  its  expenses.     This  legislation,  PL  92-318, 
authorized  $550  million  for  a  three-year  period  beginning  FY  1973  and 
further  stipulated  that  at  least  907o  of  NIE's  appropriated  funds  be  dis- 
bursed through  grants  and  contracts  with  qualified  public  and  private 
agencies  and  individuals  external  to  the  Institute^     Regarding  specifica- 
tion of  areas  of  needs,  this  enabling  legislation  created  the  National 
Council  on  Educational  Research  as  a  policy-setting  body  for  the  NIE 
(NCER  in  turn,  therefore,  would  be  a  major  contributor  to  NIE  allocations 
policy).     The  legislation  also  set  the  following  four  priority  goals  that 
expressed  Congressional  intent  regarding  NIE's  mission: 

•  To  help  solve  or  to  alleviate  the  problems  of,  and  promote 
the  reform  and  renewal  of,  American  education. 

•  To  advance  the  practice  of  education  as  an  art,  a -science, 
and  a  profession. 

•  To  strengthen  the  scientific  and  technological  foundations 
of  education. 

•  To  build  an  effective  educational  research  and  development 
system. 

The  initial  appropriation  to  NIE  for  FY  1973  was  $142, 671, 000. 
Budget  Execution  and  Control 

Although  the  initial  appropriation  to  NIE  for  FY  1973  was  given  with- 
out line-item  specification  of  amounts  to  be  obligated  for  various  target 
priorities  (as  is  often  done  in  appropriations  legislation),  a  majority 
of  these  funds  of  necessity  were  allocated  to  meet  obligations  for  pro- 
grams that  NIE  inherited  from  other  agencies — principally  the  Office  of 
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Education,  and  the  Office  of  Economic  Opportunity  (see  Table  1-4).  Under 
the  direction  of  its  policymaking  body,  NCER,  NIE  translated  the  four  goal 
statements  in  its  enabling  legislation  into  five  primary  budget  categories 
each  of  which  was  allotted  a  major  share  of  NIE's  funds: 

•  Dissemination 

•  Basic  skills  * 

•  Finance 

•  Equity 

•  Education  and  work. 

The  overall  allotment  to  each  of  these  categories  and  to  other  categories, 
such  as  administrative  expenses,  is  shown  on  Table  1-5. 

Table  1-5 

NIE  OBLIGATIONS  AND  BUDGET  ESTIMATES,  BY  PROGRAM  ACTIVITY:  1973-1976 

(In  Millions  of  Dollar's) 


Fiscal 

Year 

Budget  Categoiry 

1973 

1974. 

1975* 

1976t 

Dissemination 

$  6.0 

$  6.0 

$  5.9 

$18.4 

Basic  skills 

19.3 

12.5 

12.4 

13.9 

Finance,  productivity,  and 
management 

38.5 

16.6 

18.5 

18.3 

Equity 

4.4 

4.5 

3.0 

5.4 

Education  and  work 

18.  0 

14.0 

12.7 

9.9 

Other  projects  (not  classified) 

14. 1 

11.1 

6.2 

3.4 

Administrative  expenses  and 
intramural  research 

6.5 

11.0 

11.3 

10.7 

Total 

$106.8 

$75.  7 

$70.0 

$80.0 

* 

Estimate  of  obligations  in  the 
'^Budget  request  for  FY  1976. 

current 

fiscal 

year. 

Source:     Table  3.B/T2  (National  Institute  of  Education,  1975) 
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Review  and  Audit 

We  found  no  significant  policies  or  conclusion- bearing  reports  ema- 
nating from  either  the  Office  of  Management  and  Budget  or  from  the  General 
Accounting  Office,  which  together  are  responsible  for  conducting  review 
and  auditing  activities  to  ensure  that  agencies  such  as  NIE  do  indeed  al- 
locate and  expend  their  funds  in  accordance  with  existing  policies. 

Several  times  since  NIE*s  initial  funds  were  appropriated,  however, 
the  appropriations  subcommittees  of  both  houses  of  Congress  have  used 
their  hearings  and  their  conference  committee  reports  to  review  NIE's  con- 
duct and  to  exert  influences  on  NIE's  conduct  that  are  associated  with  the 
post-audit  process.     These  influences  will  be  discussed  below. 

Years  Subsequent  to  the  Creation  of  NIE 

Each  year,  NIE  has  been  significantly  influenced  by  allocations  policy 
decisions  that  differed  significantly  from  those  that  were  expected  by  NIE 
and  by  the  KPU  profession.     As  indicated  by  Table  1-6,  the  optimistic  ex- 
pectation that  NIE's  levels  of  funding  would  increase  over  time  was  not 
borne  out.     We  shall  not  discuss  this  important  development  other  than  to 

Table  1-6 

APPROPRIATION  HISTORY 
(In  Thousands  of  Dollars) 


Year 

Budget  Estimate 
to  Congress 

House 
Allowance 

Senate 
Allowance 

Appropriation 

1973 

$142,671 

$142,671 

$142,671 

$142,671 

1974 

187,897 

143,371 

75,  700 

75,700 

1975 

134,500 

80, 000 

0 

70,000 

Supplemental 

(pay  raise) 

357 

1976 

80,000 

Source:     NIE  Budget  Justification,  p.  11  (FY  1976) 
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illustrate  how  the  making  of  allocations  policy  is  a  significant  govern- 
ing mechanism  of  NIE.     We  will  also  illustrate  how  the  mechanism  of  ap- 
propriation setting  has  been  used  both  as  an  instruction  of  review  and 
audit^  and  as  a  way  of  establishing  substantive  need  categories  that  the 
Institute  must  address--i. e. ,  in  the  making  of  substantive  policy. 

Executive  Formulation  and  Transmittal 

NIE  requested  approximately  $162  million,  an  increase  of  some  $20 
million,  to  conduct  its  operations  during  FY  1974.     The  justification  for 
this  request  was  based  on  an  ordering  of  substantive  need  categories  dif- 
ferent from  those  explicated  by  the  Congress.     Emphasized  were: 

•  The  provision  of  essential  skills  to  all  individuals,  with 
special  emphasis  on  reading. 

•  The  improvement  of  the  productivity  of  resources  in  the 
educational  system. 

•  Understanding  and  improving  the  relationship  of  education 
to  work  and  careers. 

•  The  development  of  a  problem- solving  capacity  in  education 
systems  at  the  state  and  local  levels. 

•  Increasing  diversity  in  American  educa.tion. 

In  addition,  although  not  listed  as  a  priority,  NIE  acknowledged  a 
high  degree  of  responsibility  to  ensure  "that  the  products  of  educational 
experimentation  are  effectively  transmitted  to  teachers,  students,  local 
school  boards,  and  governmental  officials  who  are  dealing  with  day-to-day 
problems  of  American  education"  (NIE  FY  1974  Budget  Justification).  Al- 
though this  budget  and  its  justification  were  prepared  withou^^^ 
fit  of  direction  from  the  Council,  which:  was  to  be  jrespOT 
policy  (the  Council  not  having  been  nominated  by  the  President^^^^^^^a^^^^ 
firmed  by  the  Senate  in  time  to  help  formulate  the  IT  19^^  the 
Council  let  the  above  categories  stand  when  the  las3  itniM^ 


budget  was  submitted.     Neither  HEW  nor  0MB  seem  to  have  appreciably  re- 
stricted NIE ^ s  levels  of  requested  budgets. 

Congressional  Review  and  Appropriation 

In  responding  to  NIE's  request  for  approximately  $162  million  for 
FY  1974^  a  Senate  subcommittee  stated  that  NIE  appears  to  have  a  *'total 
lack  of  understanding  of  its  purpose,'*  that  NIE's  long-  and  short-range 
goals  were  "vague  and  obscure,"  and  that  if  NIE  were  to  succeed,  it  must 
first  "determine  its  proper  role  within  the  educational  system,"  (The 
Senate  Select  Subcommittee  on  Labor  and  Health,  Education  and  Welfare  Ap- 
propriations, Report  p.   80).     A  House  subcommittee  responded  a  bit  more 
sympathetically,  noting  that  NIE's  activities  "had  been  hampered  by  the 
fact  that  the  NCER  had  not  been  established  at  the  time  the  committee  held 
its  hearings  on  the  Institute's  budget,"    On  the  other  hand,  this  subcom- 
mittee reported  that  "NIE  had  not  fully  carried  out  the  intent  of  Congress 
to  assist  state  and  local  education  agencies  through  dissemination  of  re- 
search information  and  newly  developed  programs  and  practices."    As  shown 
by  Table  1-6,   the  Congress  thereupon  refused  to  appropriate  any  increase 
and  instead  decreased  NIE's  budget.     Subsequently,  the  quality  of  NIE's 
relationship  with  the  Subcommittees  on  Congressional  Appropriations  (as 
Indicated  by  formal  policies,  at  least)  seems  to  have  changed  only  to  the 
extent  that  the  Congress  became  more  substantively  restrictive  in  its  ap- 
propriations policy.     For  example.  Table  1-7  specifies  various  ways  through 
which  the  Congressional  appropriations  policy  was  used  to  direct,  NIE's 
conduct,  together  with  NIE's  proposed  responses- -such  as  increasing  al- 
locations for  dissemination  as  a  way  to  provide  assistance  to  state  arid 
local  agencies. 

A  final  entry  can  be  made  in  this  brief  summary  of  NIE  allocations 
policy.     In  response  to  heavy  lobby  pressure  from  the  Council  for  Educa- 
tional Development  and  Research  (CEDaR),  the  Congress  in  its  FY  1976 
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Table  1-7 

SIGNIFICANT  ITEMS  IN  HOUSE  AND  SENATE  COMMITTEE  REPORTS 


Activity 

Item  j 

(a)    FY  1975  House  Report 

The  CoimnLttee  stated  that  "the  Insti- 
tute has  not  fully  carried  out  the  in- 
tent of  Congress  to.  assist  state  and 
local  educational  agencies  through  dis- 
semination of  research  information  and 
newly  developed  programs  and  practices." 

The  budget  request  for  FY  1976  provides  for  three  times  the  1975  level  or  $18,343,000  for  dis- 
semination projects.     During  FY  1975  funds  are  being  provided  to' assist  approximately  30 
states  develop  or  improve  their  dissemination  activities.     The  goal  of  the  program  in  FY  1976 
is  to  provide  teachers,   administrators,  and  policymakers  outcomes  of  educational  research  and 
help  them  adapt  development  products  such  as  innovative  curricula  and  exemplary  local  prac- 
tices to  their  own  use. 

(b)    FY  1975  Senate  Report 

The  Committee  recommended  the  Institute 
take  steps  necessary  to  eliminate  mar- 
ginal, less  productive  education  RSi) 
projects  and  concentrate  efforts  on 
more  goal~orienced  activities.  The 
Committee  Hpi^cifled  the  following  as 
examples  of  the  kLnd  of  activities  on 
which  the  Institute  should  focus. 

A  proposed  study  of  school  finance 

Funds  have  been  provided  in  FY  1975  for  School  Finance  Planning  activities.     In  FY  1976  the 
Institute  will  work  closely  with  school  finance  policymakers  in  states  and  elsewhere  to  sup- 
port analyses  and  research  responding  directly  to  their  .needs. 

$32,000  wlll^be  (irovlded  in  FY  1975  and  $750,000  in  FY  1976. 

The  more  successful  educational 
laboratories  and  centers 

In  FY  1975  an  estimated  $29.8  million  will  bring  most  of  the  ongoing  lab  and  center  projects 
to  conclusion.     For  FY  1976  new  funding  decisions  ft»r  the  most  part,  will  be  made  by  NIE  per- 
sonnel with  the  advice  of  outside  experts  in  response  to  competitive  program  announcements. 
The  experience  of  many  of  the  education  laboratories  and  R&D  centers  should  enable  those  most 
capable  to  compete  successfully.    A  tentative  estimate  of  NIE  funding  for  labs  and  centers  in 
FY  1976  is  §20  million.     This  estimate  Is  based  upon  their  past  capabilities  in  undertaking 
research  and  at  providing  support  services  to  local  education  personnel,  such  as  adapting  R&D 
outcomes  to  local  school  needs. 

The  Mountain  Plains  Project 

$5.2  million  will  be  provided  in  FY  1975  and  $2.7  million  in  FY  1976.     The  decrease  reflects 
the  conclusion  of  the  research  and  development  ^phase  of  the  residential  training  program  for 
rural  families  in  the  six-state  Mt.  Plains  region. 

The  D.C.  Schools  Project 

Sinpe  the  D.C.  Schools  Project  is  currently  operating  on  funds  awarded  during  FY  1974,  funda 
will  not  be  necessary  for  continued  support  until  FY  1976.    The  budget  doea  request  $2.3  mil- 
lion, representing  the  final  year  of  the  three-year  project  in  the  Anacostia  area  of  the  Dis- 
trict of  Columbia. 

The  University  of  Mid-America 

In  FY  1976  the  University  of  Mid-America  will  be  expanded  from  a  one-state  to  a  5  state  net- 
work.    In  addition,   the  proposed  budget  of  $1.6  million,  provides  up  {to]  $0.2  million  from 
FY  1975,   to  expand  the  number  of  courses  offered  from  4  to  8. 

The  Comaittee  directed  that  $155,000  be 
provided  to  continue  operation  of  the 
Child  Study  Center'  now  operating  at 
HEW. 

$75,000  has  been  provided  in  FY  1975  to  continue  the  Office  of  Education  Child  Study  Center. 
The  FY  1976  budget  provides  for  NIE  to  support  research  in  early  childhood  education  in  con- 
junction with  the  ongoing  child  study  center.    Alternatives  deaigned  to  increase  the  impact 
of  the  research  expenditures  will  also  be  explored,  such  as  establishing  a  preschool  demon- 
stration site  in  collaboration  with  the  Smithsonian  Institution.     $200,000  is  planned  for 
FY  1976. 

The  Committee  recommended  that  an  ap- 
propriate portion  of  FY  1973  funds  be 
allotted  as  final  payment  to  the  Woat- 
ern  Institute  of  Technology. 

Necessary  FY  1973  funds  ($506,000)  have  been  provided  aa  final  payment  for  the  National  Com- 
puter Servicea,  Western  Institute  of  Technology  Project  in  Waco,  Texas. 

Source:     NIE  Budget  Justification  (FY  1976) 


appropriation  for  education  (PL  94-94)  allotted  NIE  $70,000,  000  »'for  car- 
rying out  section  405  of  the  General  Education  Provisions  Act         of  which 
up  to  $30,000,000  shall  be  made  available  by  the  Institute  to  the  educa- 
tional laboratories  and  research  and  development  centers."    Therefore,  if 
NIE  management  Intends  to  comply  with  this  mandate  sent  down  by  the  Con- 
gress,  it  will  have  to  allocate  some  44%  of  its  already  minimal  budget  of 
$70,000,000  to  a  group  that  accounts  for  only  12%  of  the  KPU  work  force.* 


This  percentage  was  calculated  on  the  "mean  estimate"  of  10,000  for  the 
current  educational  R&D  work  force  in  the  recent  DATABOOK  (National  In- 
stitute  of  Education,   1975a),  and  on  the  sum  of  1,152  that  we  derived 
from  the  professional  R&D  work  force  in  the  various  laboratories  and 
centers  that  are  listed  in  Appendix  B  of  the  recent  "R6J)  Funding  Poli- 
cies" report  (National  Institute  of  Education,  1975b). 


1-26 


V     CONCLUSIONS  AND  RECOMMENDATIONS 


Although  this  analysis  was  reported  at  a  relatively  simplistic  level, 
it  nevertheless  provides  an  adequate  basis  for  drawing  implications  about 
the  governance  of  knowledge  production  and  utilization  in  the  United  States 
Three  observations  are  especially  worthy  of  note.     First  is  NIE ' s  repeated 
pattern  of  not  receiving  its  requested  allocations  from  the  appropriations 
subcommittees  of  the  Congress.     Second  is  that  NIE*s  initial  authorization 
enabling  authorization  has  not  expired,  is  on  an  automatic  one-year  exten- 
sion, and  comes  up  for  reenactment  next  year.     Third  is  that  at  least  part 
of  NIE*s  constituency--the  laboratories  and  centers  acting  through  the 
CEDaR  organization--has  turned  to  heavy  lobbying  to  promote  its  interests. 
From  a  systems  perspective,  these  are  interesting  observations,  especially 
so  because  NIE  is  a  new  organization. 

One  of  the  systems  principles  that  seems  to  occur  throughout  all  hi- 
erarchically organized  systems,  whether  they  are  "mechanical"  or  ^'living, " 
is  the  phenomenon  of  "hierarchical  emergence."    This  is  the  phenomenon 
through  which  a  new  coherent  system  property  "emerges"  when  a  series  of 
lower  order  systems  or  configurations  begins  to  work  in  close  interaction 
over  time,  so  that  the  new  higher  level  configuration  or  system  can  have 
stable  properties  of  its  own.     An  example  is  the  way  in  which  the  gears 
in  a  clock  work  together  to  "tell  time."     ("Time"  had  nothing  to  do  with 
"the  configuration  of* gears"  in  most  scientific  disciplines  before  the 
invention  of  clccksy  but  it  emerges  as  a  property  under  the  right  condi- 
tions.)   A  more  relevant  example  is  the  way  in  which  events  like  the  es- 
tablishment of  the  NIE  create  a  concept  such  as  KPU.     As  is  true  in  all 
living  systems,  however,  the  survival  probability  of  a  mutant  organism 
or  species  is  small  unless  the  mutant  has,  by  virtue  of  its  mutation,  a 
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superior  advantage  in  its  life-support  transactions  with  the  ecologl<:^/i 
networks  surrounding  it.     This  principle,   translated  relative  to  KPU, 
means  that  NIE  as  an  institution  and  KPU  as  a  concept  must  always  have 
"currency*'  (legitimacy  and  value)  to  the  principal  stakeholders  in  the 
KPU  community.     Only  then  can  KPU  guarantee  its  survival  in  the  "jungle" 
through  which  its  allocations  policy  is  formed. 

Specifically^  this  analysis  points  to  NIE's  need  for  strong  politi- 
cal support  from  the  community  having  vested  interests  in  effective  KPU 
in  education.     Because  analysis  of  political  and  other  nonformal  influ- 
ences lies  beyond  the  scope  of  this  study,  we  shall  merely  note  several 
ways  in  which  a  monitoring  system  could  assist  those  who  lobby  for  needed 
legislation.     For  this  purpose,   the  following  yearly  or  periodic  indicators 
would  be  useful  in  the  DATABOOK: 

•  Time  series  statistics  on  the  comparative  funding  of  R&D 
in  various  disciplines  and  throughout  the  federal  govern- 
ment that  would  help  to  show  .if  NIE/KPU  is  getting  "fair 
share. " 

•  Cross- tabulations  of  funding  by  NIE  and  by  other  e_.duca- 
tional  agencies  that  would  show  the  proportion  of  support 
received  by  various  categories  of  activities  (also  dis- 
cussed in  Case  Study  II). 

•  Listings  of  formal  lobby  activities  conducted  by  consti- 
tuent groups  in  KPU--both  the  substantive  target  of  the 
lobby  and  the  level  of  priority  given  to  the  target. 
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VI    ADEQUACY  OF  THE  ANALYTICAL  APPROACH 

It  is  somewhat  difficult  to  assess  the  adequacy  of  the  analytical 
approach  in  this  case  study  because  the  analyst  who  worked  up  the  case 
material  left  the  project  before  the  final  results  were  written. 

One  tentative  conclusian  from  this  case,  however,  is  that  the  "simple" 
mode  of  describing  the  significant  policies,  activities,  resources,  and 
agents  in  a  given  configuration  or  set  of  configurations  offers  little 
value  over  other  methods  of  portraying  social  organization.  Furthermore, 
it  appears  that,  as  in  journalism,  one  needs  approximately  four  times  the 
information  that  one  actually  sets  down  in  writing  if  one  is  to  adequately 
treat  the  topic  at  a  given  level  of  detail  and  complexity.     Therefore,  al- 
though we  remained  consistent  with  our  early  decision  to  pursue  a  "simple" 
mode  of  analysis  and  description,  we  necessarily  had  to  consider  various 
"complex"  and  "interactive"  configurations  through  which  NIE  allocations 
policies  are  made.     It  was  for  searching  out  these  more  detailed,  dynamic, 
and  complex  relationships  that  the  analytical  approach  was  found  most  use- 
ful.    Specifically,  it  was  helpful  in  deciding  how  much  information  to 
seek  at  various  stages  during  the  study  (whether  to  make  the  inquiry  more 
'convergent  or  divergent  at  each  step),  where  to  seek  it  (whether  to  stay 
at  the  level  .of  codified  policy  or  to  seek  out  internal  memoranda),  and 
how  to  organize  the  information  for  analysis  (the  framework  offering  sev- 
eral alternatives  to  try). 

Our  overall  conclusion  regarding  adequacy,  however,  is  that  a  "simple" 
use  of  the  analytical  approach  provides  real  assistance  during  the  early 
stages  of  inquiry,  but  much  less  assistance  during  the  final  write-up. 
We  believe  that  the  analytical  approach  would  be  valuable  both  for  guiding 
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the  gathering  of  information  and  for  describing  the  results  of  a  topic 
like  this  if  it  were  done  at  a  more  detailed  and  complex  level  of  effort. 

Although  we  did  not  suggest  that  NIE  sponsor  such  a  study^,   the  ap- 
proach should  be  useful  as  a  way  to  help  document  and  describe  all  the 
major  stages,  activities,  and  governing  policies  through  which  NIE  pro- 
gram governance  takes  place-- from  routine  budgetary  planning,  through  the 
making  and  monitoring  of  awards,   to  postprogram  audit  and  the  use  of  past 
results  in  forward  strategy  making. 
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TAXONOMY  OF  POLICIES  SELECTED  AS  MOST 
SIGNIFICANT  IN  NIE'S  ALLOCATION  PROCESS 
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I  INTRODUCTION 


Several  federal  agencies  support  education  R&D,  including  the  De- 
partment of  Defense  and  the  National  Science  Foundation  (see  Table  II-l), 
However,  one,  the  National  Institute  of  Education  (NIE) ,  has  been  given 
preeminent  responsibility  for  the  support  of  R&D  related  to  education 
[see  Public  Law  (PL)  92-318,  Section  405].     The  purpose  of  this  analysis 
is  to  delineate  the  coverage  and  possible  impact  of  NIE's  formal  R&D  pro- 
curement policy  on  the  EKPU  system.     The  focus  of  analysis  is  the  NIE 
project  officer:     that  is,  the  analysis  attempts  to  identify  and  de- 
scribe the  decisions  and  activities  undertaken  by  the  project  officer  in 
procuring  education  R&D.    The  field  of  analysis  is  the  regulations  and 
mandated  procedures  that  govern  the  activities  of  the  project  officer 
(and  other  actors).     The  analysis  is  restricted  to  the  formal  system  of 
legally  and  bureaucrat ically  binding  directives. 

Procurement  is  a  substantial  activity  for  the  U,S.  government.  In 
the  1972  fiscal  year,  the  U,S.  government  spent  $57.5  billion  on  the 
procurement  of  goods  and  services  and  an  additional  $39.1  billion  on 
grants --a  total  of  40%  of  the  federal  budget.    Regulating  these  procure- 
ments is  a  complex  system  of  over  4000  provisions  of  the  U,S.  Code  (Com- 
mission  on  Government  Procurement,  1972,  Vol,  I,  p.   10);  implementing 
and  enforcing  these  provisions  is  a  work  force  of  over  80,000  federal 
employees  (Commission  on  Government  Procurement,  1972,  Vol.  I,  p.  2). 


We  realize  that  informal  influences  may  affect  R&D  procurement  out- 
comes as  much  as  the  formal  regulations  do,  but  without  a  map  of  the 
formal  regulations,  it  would  be  difficult  to  identify  the  points  at 
which  informal  influences  might  be  of  most  importance. 

list  of  references  is  attached  to  this  case  study. 
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Table  II-l 


FEDERAL  OUTLAYS  FOR  PERSONNEL  TRAINING  AND 
RESEARCH  IN  EDUCATION 


Outlays  (mitliont) 

Proiram   

1974  1975  1976 

actual      ••tiroatc  attimate 


Education  perionnel  traininf : 

Educational  development   115  80  28 

Occupatiooal.  adult  and  vocational   14  32  52 

Emergency  ichbol  aMistance   16  14  12 

Education  for  the  handicapped   32  39  33 

College  teacher  fellowihipt  (OE)   26  8  4 

Office  of  Child  Development   22  22  20 

National  Science  Foundation   13  17  14 

Other  _   7  15  24 


Subtotal,  education  personnel  training   245         227  187 


Educational  research: 

Educational  development   123  68  II 

Elementary  and  Secondary  Education  Act   22  83  98 

Education  for  the  handicapped   35  31  32 

Occupational,  vocational  and  adult  education    50  48  102 

National  Institute  of  Education   97  82  84 

National  Foundation  on  the  Arts  and  Humanities   20  34  36 

National  Science  Foundation   31  37  41 

Other   21  43  50 


SubtoUl.  educational  research   399         426  454 


Total   C44         853  MI 


The  Office  of  Education  funds  most  of  the  educational  training  and 
the  National  Institute  of  Education  funds  a  significant  part  of^educa- 
tional  research  through  a  wide  range  of  programs.  The  OflBce  of 
Education  will  provide  70%  of  the  money  for  personnel  training  in 
1976;  the  National  Institute  of  Education  will  provide  20%  of  the 
funds  for  research  in  1976. 


Source;    Office  of  Management  and  Budget,  Special  Anal- 
yses;    Budget  of  the  United  States  Government, 
Fiscal  Year  1976,  p.  148  (USGPO-,  Washington, 
D.C.  ,  1975) 


As  a  result  of  its  position  within  the  federal  government,  NIE  must  con- 
form to  a  host  of  regulations  and  procedures  originally  developed  for 
other  agencies  or  for  the  procurement  of  "products"  other  than  R&D. 

All  procurement  statutes  and  regulations  assume  a  common  set  of 
steps  and  activities  in  the  procurement  process.     For  convenience,  we 
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will  organize  our  discussion  on  the  same  set  of  steps  and  activities. 
(We  will  later  point  out,  however,  that  these  assumptions  are  not  always 
appropriate  for  the  procurement  of  R6cD.) 

The  procurement  process  begins  with  the  identification  of  needs  and 
the  appropriation  of  funds  to  meet  these  needs  (see  Case  Study  I).  The 
agency  then  plans  how  the  funds  should  be  spent,  solicits  offers  from 
individuals  or  organizations  to  carry  out  the  plans,  may  or  may  not  ne- 
gotiate with  a  subset  of  offerors,  awards  the  funds,  and  oversees  their 
expenditure.     The  process  ends  with  the  delivery  of  the  needed  goods  or 
services.     The  overall  goal  of  the  process  is  to  procure  high-quality 
needed  goods  and  services  at  the  lowest  feasible  cost  through  free  and 
open  competition,     (As  with  all  complex  social  systems,  the  procurement 
process  also  serves  other  goals.     For  example it  serves  the  economic 
goal  of  stimulating  certain  industries  and  labor  markets;  it  also  serves 
certain  social  goals  such  as  the  prohibition  of  employment  discrimina- 
tion on  the  basis  of  race  or  sex,)    Figure  II-l  is  a  representation-  of 
the  general  procurement  process. 

The  principle  of  free  and  open  competition  governs  almost  all  of 
the  procurement  regulations.     The  basic  procurement  mechanism  is  that  of 
formal  advertising  in  which  goods  or  services  specifications  are  pub- 
lished, sealed  bids  are  tendered,  and  the  individual  or  firm  with  the 
lowest  bid  is  awarded  the  contract.     Formal  advertising  is  almost  never 
appropriate  for  procuring  R&D;  the  inability  to  prespecify  detailed  re- 
sults and  the  desire  for  creativity  and  innovation  preclude  its  use. 
Exceptions  to  the  formal  advertising  procedure  are  permitted  (i, e, ,  it 
is  possible  to  negotiate  a  contract)  ,  but  only  after  the  agency  head  is- 
sues a  determination  and  finding  that  formal  advertising  is  inappropriate 
(Commission  on  Federal  Procurement,  Vol.  II,  p.  25).     Even  within  the 
procedures  for  awarding  negotiated  contracts,  the  principle  of  competi- 
tion is  carefully  fostered  under  the  assumption  that  competition  will 
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Source:  Commission  on  Government  Procurement,  Report  of  the  Commission  on 

Government  Procurement, }Jo\.  I:  General  Procurement  Considerations,  p.2 
(USGPO,  Washington,  D.C.*,  1972) 


FIGURE  11-1    REPRESENTATION  OF  THE  GENERAL  PROCUREMENT  PROCESS 

ensure  the  best  possible  product  for  the  government.     Although  organiza- 
tion structure  may  vary  from  agency  to  agency,  most  R6J)  procurement  ac- 
tivities entail  both  a  project  officer  and  a  contracting  officer.  The 
project  officer  usually  initiates  the  activities  (defining  a  need,  de- 
scribing goods  or  services  that  could  meet  that  need,  and  so  forth)  that 
might  culminate  in  R&D  procurement.     He  or  she  is  particularly  concerned 
with  the  technical  quality  of  that  which  is  procured.     The  contracting 
officer  is  the  only  government  agent  legally  empowered  to  make  financial 
commitments  on  behalf  of  the  federal  government.    He  or  she  is  respon- 
sible for  ensuring  that  any /procurement  is  both  legal  and  advantageous 
for  the  government.     Although  the  project  officer  and  contracting  officer 

■     .  II-4  .   ;.  •' 


(noted  as  procurement  officer  on  Figure  II-2)  are  often  located  in  sepa- 
rate parts  of  the  organization  structure,  the  successful  completion  of 
an  R6tD  procurement  action  requires  that  they  work  together  closely. 
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Source:  Commission  on  Government  Procurement,  Report  of  the  Commission  on 
Government  Procurement,  Vol.  II,  p.  11  (USGPO,  Washington,  D.C.,  1972) 


FIGURE  11-2    GOVERNMENT  AGENCY  OPERATION  FOR  R&D  PROCUREMENT 
'     AND  ADMINISTRATION 
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II    COMPONENTS  OF  NIE  R6cD  PROCUREMENT  SYSTEM 

Sources  That  Establish  NIE  Procurement  Regulations 

The  three  major  sources  that  establish  formal  procurement  policy 
for  NIE  are  Congress,  the  courts,  and  the  executive  branch  of  government. 
Congress  can  pass  both  general  procurement  legislation  to  which  NIE  must 
adhere  (for  example,  the  Federal  Property  and  Administrative  Services 
Act  of  1949)  and  legislation  specific  to  NIE  (for  example,  the  provision 
in  NIE*s  authorizing  legislation  that  at  least  90%  of  its  R&D  funds  be 
spent  externally  or  the  provision  of  the  NIE  1975  appropriations  bill, 
which  stipulated  that  no  recipient  of  NIE  funds  could  receive  an  annual 
salary  larger  than  that  of  the  U.S.  Commissioner  of  Education).     In  ad- 
dition to  passing  legislation.  Congress  shapes  NIE  procurement  policy 
through  its  review  agency--the  General  Accounting  Of f ice--which  certi- 
fies the  legality  of  contractual  disbursements  and  audits  specific  pro- 
curement activities.     The  courts  affect  NIE  procurement  policy  through 
their  judicial  review  of  individual  statutes  and  contract  disputes.  The 
executive  branch  affects  NIE  procurement  policy  through  Executive  Orders, 
'Office  of  Management  and  Budget  Directives,  the  General  Services  Adminis- 
tration Federal  Procurement  Regulations,  and  HEW  directives  and  policies. 

As  a  result  of  NIE's  authorizing  legislation,  NIE  procurement  pol- 
icy may  be  shaped  by  yet  another  actor.     Public  Law  92-318  stipulated 
that  the  National  Council  on  Education  Research  (NCER) ,  a  fifteen-member 
Council  appointed  by  the  President,  would  have  "policymaking  authority" 
for  NIE.     Thus  far,  NCER  influence  with  respect  to  R&D  procurement  has 
been  confined  to  setting  level-of -effort  directives  for  spending  and 
approving  specific  programs.     Theoretically,  however,  it  could  intervene 
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in  the  procurement  process  itself,  mandating  procedures  at  variance  with 
those  promulgated  by  HEW  for  its  member  agencies.     (See  Figure  II-3  for 
major  sources  of  NIE  procurement  policyO 

Policies 

NIE*s  procurement  activities  are  generally  governed  by  Title  III  of 
the  Federal  Property  and  Administrative  Services  Act  of  1949  [41  U.S.C, 
251-260  (1970)],     This  act  gives  either  the  President  or  the  Administra- 
tor of  the  General  Services  Administration  (GSA)  authority  to  prescribe 
procurement  regulations  or  policies  for  civilian  agencies.     The  Federal 
Procurement  Regulations,  issued  by  GSA,  stipulate  the  major  regulations 
governing  procurement.    Procurement  by  contract  is  governed  by  Chapters 
1  and  3  of  Title  41  of  the  Code  of  Federal  Regulations.     The  award  and 
administration  of  educational  research  grants  by  NIE  Is  governed  by 
Chapter  14  of  Title  45  of  the  Code  of  Federal  Regulations.    NIE  is  also 
subject:  to  collateral  regulations  governing,  for  example,  application  of 
Title  VI  of  the  Civil  Rights  Act  of  1964  (PL  88-352),  and^Title  IX  of 
the  Educational  Amendments  of  1972  (PL  92-318).     Congress  also  enacts 
legislation  specific  to  NIE  that  may  affect  its  procurement  policies. 
For  example,  each  year  NIE's  appropriations  act  has  stipulated  that  all 
appropriated  funds  be  expended  by  the  end  of  the  fiscal  year*     This  pro- 
vision necessarily  imposes  certain  deadlines  upon  the  procurement  process. 

Some  of  the  major  regulations  governing  federal  procurement  have 
been. explained  or  interpreted  for  NIE  professional  staff  (including 
project  officers)  in  one  section  of  the  NIE  Directives  System  (NIE  Guides 
16.0,01  to  16.0.13),     These  directives,  issued  by  the  NIE  Office  of  Ad- 
ministration, establish  procedures  for  implementing  various  provisions 
of  procurement  policy  and  guide  the  NIE  project  officer  through  some  of 
the  decision  points  and  activities  associated  with  procurement.  Because 
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the  NIE  directives,  rather  than  the  legal  documents  embodying  the  procure- 
ment regulations,  provide  the  day-to-day  guidance  for  the  NIE  project 
officer,  we  will  often  cite  them  as  the  basis  for  policy  guidance.  It 
should  be  understood,  however,  that  the  directives  are  based  upon  the 
statutes  and  regulations  described  above.     (See  Table  II-2  for  selected 
major  policies  and  regulations  governing  NIE  procurement.) 

Agents 

As  stated  above,  the  primary  focus  of  this  analysis  is  the  NIE  pro- 
ject officer.     Because  the  contracting  officer  has  legal  responsibility 
for  all  procurement  actions,  he  or  she  is  also  a  major  agent  in  this 
analysis.     Agents  in  the  field  of  analysis*  are  NIE  review  authorities 
and  NIE  sign-off  authorities.     Because  we  take  the  policies  as  given,  we 
do  not  include  any  of  the  policy-setting  agents,  such  as  Congress,  in 
the  analysis. 

Procurables 

There  are  a  number  of  goods  and  services,  which  might  fall  under 
the  general  category  of  education  R&D,  that  NIE  might  wish  to  process. 
Not  all  of  them  are  subject  to  the  Federal  Procurement  Regulations  (see 
Table  II-3) .     The  three  major  kinds  of  goods  and  services  that  are 
governed  by  the  Code  of  Federal  Regulations  are  expert  nonpersonal  ser- 
vices (i.e.,  consultant  services),  task  completions,  and  level  of  effort 
work.     Although  we  discuss  ail  three  classes  of  procurables,  the  major 
focus  is  on  task  completions. 

Activities 

Activities  in  the  procurement  process  are  described  in  Section  III. 
There  are  three  basic  activities  within  the  procurement  process:     (1)  de- 
cisions that  are  guided  by  policy  statements  (for  example,  it  may  be 
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Table  II-2 

SELECTED  MAJOR  POLICIES  AND  REGULATIONS  GOVERNING  NIE  PROCUREMENT 


Procuring  R&D  by  Obliging  Funds 

Any  portion  of  an  NIE  appropriation  that  is  not  obligated  by  the  end  of  the  current  fiscal  year  must 
be  returned  to  the  Treasury  (Annual/Labor/HEW  Appropriations  Bills) 

ObligatinR  Funds  for  R&D 

"...  only  a  Contracting  Officer  can  obligate  the  government  to  the  expenditure  of  funds  in  connection 
with  the  award  of  a  contract  or  grant,"  p.    2  [NIE  Guide  16. 0.01--Chs .  1  and  3,  Title  41,  Code  of 
Federal  Regulations  (CFR) I 

Allocatinfi  Funds  to  Extramural  or  Intramural  Research 

NIE  must  allocate  at  least  90%  of  its  R&D  funds  to  extramural  work  (Public  Law  92-318,  Section  405) 

Publicizing  Proposed  Procurements 

"Federal  Procurement  Regulations  require  that  proposed  procurements  of  $5000  or  more,  with  few  excep- 
tions, be  publicized  in  the  Commerce  Business  Daily,"  p.   1  (NIE  Guide  16. 0. ll--Title  41,  CFR) 

Procuring  R&D  by  Contract 

"It  is  the  policy  of  the  Institute  that  the  contract  shall  be  the- mandatory  instrument  ...."p.  2 
(with  certain  exceptions)  (NIE  Guide  16.0.07,  p.  2--Chs.   1  and  3,  Title  41,  CFR) 

Procuring  by  Competition 

"It  is  the  policy  of  the  Institute  that  competition  be  obtained  to  the  maximum  extent  practicable  con- 
sistent with  the  nature  and  scope  of  any  proposed  procurement,"  p.  1  (NIE  Guide  16.0.02--Ch.  3,  Title 
41,  CFR) 

Soliciting  R&D  Proposals 

"it  is  the  policy  of  the  Institute  that  only  those  sources  that  have  been  evaluated  and  considered 
technically  qualified  to  perform  research  and  development  of  the  type  required  by  the  statement  of 
work  in  the  solicit  ation  shall  be  solicited,"  p.  2  (for  procurement  by  contract)   (NIE  Guide  16.0*11) 

Limiting  Solicitation  for  Procuring  R&D  by  Contract 

"The  desirable  element  of  competition  must  be  maintained  by  the  extremes  of  solicitation  of  all  inter- 
ested sources  when  an  excessive  number  of  potential  sources  have  been  identified,  or  noncompetitive 
solicitation,  should  be  avoided  unless  clearly  warranted,"  p.  3.     This  pertains  to  solicitation  for  a 
contract  procurement  (NIE  Guide  16.0.11— Chs.   1  and  3,  Title  41,  CFR) 

Soliciting  R&D  Proposals 

"it  is  the  policy  of  the  Institute  to  provide  announcements  of  grant  assistance  to  all  interested  in- 
dividuals and  organizations  and  to  formally  publish  notice  of  these  announcements  in  the  Federal 
Register,"  p.  3  (NIE  Guide  16. 0.  ll—Title  45,  Chapter  14,  CFR) 

Requirements  for  RFP 

"The  Contracting  Officer  is  responsible  for  assuring  that  the  RFP  is  complete  ....     It  shall  be  in 
writing;  shall  specify  a  date  for  the  submission  of  proposals. . .must  include  terms,  conditions  and 
provisions  that  will  constitute  the  final  definitive  contract,  and  specify  all  the  information  that 
prospective  contractors  are  required  to  furnish  to  permit  a  meaningful  and  equitable  evaluation  of 
their  offerors.    Criteria  for  evaluating  prospective  contractor  proposals  will  be  stated  along  with 
their  relative  weights   "  p.  2  (NIE  Guide  16.0.10--Ch.  3,  Title  41,  CFR) 

Debriefing  Unsuccessful  Offerors 

"The  Institute's  policy  is  to  debrief  all  unsuccessful  offerors  who  so  request  as  to  the  reasons  their 
proposals  were  not  accepted,"  p.  4  (NIE  Guide  16.0.12) 

Contract  Close'Out 

"Final  review  and  acceptance  of  the  services  or  . products  provided  under  contract  must  be  accomplished 
by  the  project  officer  ....     The  contract  close-out  is  the  responsibility  of  the  Contracting  Officer," 
p.  5  (NIE  Guide  16.0.13,  Title  41,  CFR) 
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Table  II-3 

CATEGORIES  OF  PROCURABLES  MD  REGULATIONS 
GOVERNING  THEIR  PROCUREMENT 


^  Procurable 

Applicable  Regulations 

Materials  and  supplies 

Personal  services  (subject  to 
employer/employee  relationship) 

Advice  from  an  advisory  com- 
mittee 

Expert  nonpersonal  services 
(consultant,  field  reader,  and 
the  like) 

Task  completions  (development 
of  end  items,  new  methods,  or 
other  tangible  results) 

Level  of  effort  with  a  report 
describing  the  results  of  the 
effort 

Formal  advertising  (Code  of 
Federal  Regulations) 

Civil  Service  Regulations 

Federal  Advisory  Committee  Act-- 
Civil  Service  Regulations 

Negotiated  procurement  by  con- 
tract (Code  of  Federal  Regula- 
tions) 

Negotiated  procurement  by 
contract  (Code  of  Federal  Regula- 
tions) 

Grant  award  (Code  of  Federal 
Regulations) 

necessary  to  decide  whether  to  use  a  contract  or  grant;  NIE  policy  stip« 
ulates  that  the  contract  is  usually  the  preferred  instrument);  (2)  le- 
gally mandated  activities  [for  example,  the  Code  of  Federal  Regulations 
stipulates  that  the  contracting  officer  will  issue  any  Request  for  Pro-- 
posal  (RFP)  and  will  be  responsible  for  receiving  and  handling  all  so- 
licited proposals];  and  (3)  activities  that  are  necessary  to  implement 
the  policies  (for  example,  both  Titles  41  and  45  of  the  Code  of  Federal 
Regulations  stipulate  that  all  proposals  must  be  evaluated  according  to 
uniform  criteria;  developing  uniform  proposal  evaluation  criteria  for 
each  procurement  action  is  thus  necessary  for  implementing  the  regula- 
tion) . 

i 
* 
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Ill    DECISIONS  AND  ACTIVITIES  IN  THE  PROCUREMENT  OF  EDUCATION  R&D 


In this  section  we  describe  the  general  process  for  the  procurement 
of  education  R&D  by  NIE.     We  identify  key  decision  points  and  describe 
the  procurement  regulations  or  policy  directives  applicable  at  each 
point.     We  also  describe  the  activities  to  be  carried  out  by  the  project 
officer,  as  mandated  by  the  regulations  and  directives,  during  each 
phase  of  the  procurement  process. 

We  will  assume  a  need  has  been  identified  and  resources  are  avail- 
able to  underwrite  R&D  addressed  to  that  need.     (Obviously  these  two 
requirements  are  themselves  the  result  of  policy  decisions  by  the  Con- 
gress and  NCER.)    An  idea  to  meet  the  need  may  be  developed  by  someone 
in  the  field  who  has  had  no  contact  with  the  project  officer  and  who 
submits  the  idea  as  an  unsolicited  proposal,  or  the  idea  may  be  devel- 
oped by  the  project  officer  himself.    We  will  consider  only  the  latter 
case.     (See  Figure  II-4  for  the  procurement  process  decision  tree.)  One 
of  the  first  decisions  the  NIE  project  officer    must  make  is  whether  to 
use  an. internal  or  external  performer.  / 

Internal  or  External  Performer 

NIE's  authorizing  legislation  stipulated  that  at  least  907o  of  its 
operating  funds  be  spent  externally.    Technically,  then,  up  to  107o  of 
NIE's  R6eD  may  be  performed  internally.     In  this  hypothetical  case,  if 
NIE  had  not  already  obligated  107o  of  its  operating  budget  to  other 


Although  we  use  the  project  officer  as  the  decision  maker,  we  under- 
stand these  decisions  may  be  made  at  the  level  of  Director,  Deputy 
Director,  Assistant  Director,  project  officer,  or  in  combination. 
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EXCEPTIONS  TO  POLICY-PREFERRED  DECISIONS 
(For  Figure  II-4) 


External  performer  is  preferred  to  internal  performer 

Exception:     If  at  least  90%  of  the  agency's  funds  have  been  or 
will  be  committed  to  extramural  work,  then  an  in- 
ternal performer  may  be  preferred. 

Contract  is  preferred  to  grant 

Exception:     If  it  is  determined  that  all  of  the  following  condi- 
tions can  be  met: 

(a)  The  purpose  of  the  program/project  is  for 
the  financial  support  of  an  individual,  a 
group,  or  an  organization. 

(b)  The  objectives  of  the  program/project  are 
not  so  essential  as  to  preclude  unilateral 
termination  of  the  agreement  by  the  grantee 
without  penalty  or. recourse  by  the  Institute. 

(c)  Performance  of  the  program/project  and  the 
nature  and  contents  thereof  may  be  predicated 
on  a  best-effort  basis  and  may  be  l&ft  to  the 
primary  discretion  of  the  researcher  or  or- 
ganization. 


Notwithstanding  the  foregoing,  the  contract  shall 
be  mandatory  when  (1)  an  award  is  to  be  made  to  a 
profit-making  organization,  or  (2)  payment  of  an 
amount  in  excess  of  actual  costs  (i.e.,  profit  or 
fee)   [is]  intended  (NIE  Guide  16.0.07,  pp.  2-3). 

Formal  advertising  is  preferred  to  negotiated  procurement 

Exception:  There  are  fifteen  exceptions,  one  of  which  is  the  pro- 
curement of  research  and  development. 

Competitive  procurement  is  preferred  to  noncompetitive  procurement 

Exception:  When  one  organization  or  individual  possesses  predomi- 
nant capability  to  the  extent  of  precluding  meaningful 
competition. 
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internal  R&D,  the  project  officer  might  decide  that  the  work  could  best 
be  done  internally.     Practically,  a  number  of  factors  unrelated  to  the 
procurement  regulations  probably  determine  the  outcome  of  this  decision, 
includ ing: 

•  Budget  Slack--When  resources  are  less  than  anticipated, 
potential  internal  research  funds  are  probably  allocated, 
for  political  reasons,  to  external  funding. 

•  Organization  Stability--The  best  way  for  project  officers 
to  guarantee  the  stability  of  their  funds  is  to  obligate 
them  in  legally  binding  contracts.     If  a  project  officer 
is  worried  that  other  programs  may  raid  his  budget,  he 
may  decide  to  use  external  contracts  even  though  the  work 
could  be  performed  adequately  internally. 

•  Internal  Capability--At  the  current  level  of  effort,  NIE's 
internal  research  capability  is  substantially  limited  to 
small-scale  research  and  policy  studies  in  those  few  areas 
in  which  research  personnel  are  already  on  the  staff, 

•  Internal  Communication- -The  project  officer  must  be  aware 
of . the  research  capability  inside  NIE, 

Assuming  that  the  project  officer  has  decided  the  work  should  be 
performed  externally,  the  next  decision  may  be  whether  to  use  a  grant 
or  contract  to  procure  the  needed  work. 

Grant  or  Contract 

The  principal  distinction  between  the  grant  and  the  contract  is  in 
the  degree  of  responsibility  for  performance  stipulated  under  each  in- 
strument. ' 

A  contract  is  an  agreement  between  two  or  more  persons  con- 
sisting of  a  promise  or  mutual  promises  which  the  law  will 
enforce,  or  the  performance  of  which  the  law  in  some  way 
recognizes  as  a  duty.     A  grant,  on  the  other  hand,  is  a  pay-   '  V 
ment  in  cash  or  in  kind  made  to  provide  assistance  for  spec- 
ified purposes  (NIE  Guide  No.  16.0.07,  January  16,  1975,  p.  1). 
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Making  the  decision  between  the  use  of  a  grant  instrument  and  the  use  of 
a  contract  instrument  is  not  always  easy,  but  it  is  NIE  policy  to  use 
the  contract  whenever  possible  (NIE  Guide  No.  16.0.07,  January  16,  1975, 
p.  2).    NIE  specifies  that  the  contract  is  the  mandatory  fiscal  instru- 
ment unless  all  of  the  following  conditions  can  be  met: 

•  The  purpose  of  the  program/project  is  for  the  financial 
support  of  an  individual,  a  group ,  or  an  organization. 

•  The  objectives  of  the  program/project  are  not  so  essential 

as  to  preclude  unilateral  termination  of  the  agreement  by 

the  grantee  without  penalty  or  recourse  by  the  Institute. 

• 

•  Performance  of  the  program/project  and  the  nature  and  con- 
tents thereof  may  be  predicated  on  a  best-ef feort  basis  and 
may  be  left  to  the  primary  discretion  of  the  researcher  or 
organization  (NIE  Guide  No.  16.0.07,  January  16,  1975, 

pp.  2-3). 

In  addition,  no  grant  may  be  awarded  to  a  profit-making  organization  or 
for  an  amount  larger  than  actual  costs  (NIE  Guide  No.  16.0.07,  January 
16,  1975,  p.  3). 

The  procedures  leading  to  the  award  of  a  grant  are  governed  by 

Chapter  14  of  Title  45  of  the  Code  of  Federal  Regulations;  those  leading 

to  the  award  of  a  contract  are. governed  by  Chapters  1  and  3  of  Title  41 

of  the  Code  of  Federal  Regulations.-    Because  the  procedures  are  somewhat 

different  (although  still  falling  within  the  general  procurement  process 

described  above),  each  is  discussed  separately  below, 

\  .  ■  ■  .  . 
  * 

Procurement  via  the  Contract  Instrument 

Presolicitation  Phase — During  the  presolicitation  phase,  the  pro- 
ject officer  must  generate  all  the  information  necessary  to  make  a  legal 

This  section  discusses  procurement  of  what  might  be  termed  corporate 
goods  and  services.     The  contract  may  also  be  used  to  procure  individ- 
ual expert  and  consultant  services  (see  NIE  Guide  No.  16.0.05) • 
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and  successful  solicitation.     The  basic  activities  include  describing 
the  work  to  be  done,  developing  a  list  of  potential  sources  who  might  do 
the  work,  and  describing  the  criteria  by  which  the  various  offers  to  do 
the  work  will  be  evaluated. 

The  description  of  work  to  be  done  forms  the  basis  for  soliciting 
offers  from  the  field  and  provides  the  technical  provisions  that  will 
ultimately  be  incorporated  in  the  procurement  contract.     It  allows  the 
project  officer  to  justify  using  a  negotiated  procurement  rather  than 
the  formal  advertising  method  of  procurement.     The  specification  of  the 
statement  of  work  must  include  "a  precise  statement  of  the  objectives 
sought,  the  work  to  be  performed  in  reaching  those  objectives,  and  the 
specific  areas  of  investigation  required"  (NIE  Guide  No.  16.0.10, 
January  16,  1975,  p.   2).     When  applicable,   information  on  helpful  back- 
ground information,   technical  requirements,  parameters  for  measurement 
of  effort,  and  other  special  considerations  should  also  be  included  (NIE 
Guide  No.  16.0.10,  January  16,  1975,  pp.  2-3).     The  HEW  guidelines  for 
project  officers  heavily  stress  the  importance  of  specificity  in  the 
work  statement. 

The  work  statement  should  be  worded  so  as'  to  make  more  than 
one  interpretation  virtually  impossible  ....     The  work 
statement  should  state  specifically  what  the  contractor  and 
the  Government  agree  to  do;  requirements  should  be  stated 
so  clearly  that  the  Government  project  officer  who  is  re- 
sponsible for  acceptance  of  the  product  or  report  will  have 
no  difficulty  in  determining  if  the  contractor  has  complied 
with  the  contract.     If  the  work  statement  does  not  state 
exactly  what  is  wanted  or  does  not  state  it  well,  it  will 
be  ambiguous  and  will  generate  many  contract  management 
problems  for  both  the  project  officer  and  the  contracting 
officer.     Ambiguous  work  statements  can  create  unsatisfac- 
tory performance,  delays,  disputes,  and  result  in  higher 
costs  (HEW,  July  1971,  pp.  5-6). 

In  concert  with  the  statement  of  work,   the  project  officer 
should  develop  the  criteria  that  will  be  used  to  evaluate 
proposals.     These  should  include: 
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a.  Understanding  of  the  statement  of  work  ... 

b.  Availability  of  competence  in  personnel  . . . 

c.  Innovative  ideas  ... 

d.  Availability  of  facilities  ... 

e.  Willingness  to  devote  resources  ... 

f.  Management  and  organization  structure  ... 

g.  Capability  and  capacity  to  enter  into  successive  phases 

of  study  ...     (NIE  Guide  No.   16.0.10,  January  16,   1975,  p.  3). 

Evaluation  criteria  must  be  written  in  specific  terms  ''that  will  be 
readily  understood  by  the  evaluator.     They  should  be  discriminating, 
capable  of  allowing  the  user  to  draw  clear  distinctions  between  compet- 
ing proposals"  (NIE  Guide  No.   16.0.10,  January  16,   1975,  p.  3). 

Developing  a  source  selection  strategy  in  effect  defines  the  uni- 
verse from  which  proposals  will  be  drawn.     The  two  extremes  are  solicit- 
ing from  all  interested  sources  and  soliciting  only  from  a  single  source 
Both  extremes  are  to  be  avoided  "unless  clearly  warranted"  according  to 
the  NIE  Guide  (NIE  Guide  No.   16.0.11,  January  16,   1975).     Tf  it  is  clear 
that  only  one  organization  (or  one  individual,  in  the  case  of  a  consul- 
tant contract)  has  the  capability  to  perform  the  needed  work,  then  the 
project  officer  may  recommend  a  noncompetitive,  or  sole-source,  solici- 
tation and  procurement.     This  must  be  justified  by  the  project  officer 
with  respect  to: 

* 

•  Why  meaningful  competition  is  precluded. 

•  How  the  proposed  contractor  exclusively  meets  the  require- 
ments of  the  competition. 

•  How  other  sources  in  the  field  lack  the  particular  requi- 
site capabilities  (NIE  Guide  No.   16.0.02,  January  16, 
1975,  pp.  1-2). 

For  procurements  above  $2500,  the  just  if ication  must  be  reviewed  by  a 
Project  Review  Board  or  the  NIE  Contracts  and  Grants  Review  Board.  The 
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justification  must  be  approved  by  the  Chief  of  the  Contracts  and  Grants 
Management  Division  for  procurements  up  to  $25,000,  by  the  Associate 
Director  for  Administration  for  procurements  up  to  $100,000  and  by  the 
Deputy  Director  or  Director  for  procurements  above  $100,000  (NIE  Guide 
No.  16.0.02,  January  16,  1975,  pp.  2-3). 

Assuming  that  a  sole-source  solicitation  and  procurement  is  not 
justified,  sources  may  be  drawn  from  the  project  officer's  own  profes- 
sional contacts,  journals,  the  NIE  lists  of  potential  bidders  compiled 
from  Standard  Form '129,  Bidder's  Mailing  List  Applications,  and  replies 
to  Commerce  Business  Daily  synopses.     The  Federal  Procurement  Regula- 
tions require  that  a  synopsis  of  proposed  procurements  greater  than 
$5000  (whether  competitive  or  noncompetitive)  be  published  in  Commerce 
Business  Daily.     There  are  three  types  of  sjmopses,  two  of  which  may 
yield  candidates  for  the  source  selection  list,     A  Request  for  Proposal 
Available  synopsis  describes  the  proposed  procurement  and  tells  prospec- 
tive offerors  how  to  obtain  a  copy  of  the  procurement  request.     A  Sources 
Sought  synopsis  describes  the  proposed  procurement  (or  a  more  general 
area  in  which  work  may  be  supported) ,  the  criteria  to  be  used  in  evalu- 
ating potential  sources,  and  asks  interested  potential  sources  to  submit 
information  on  their  technical  capabilities.     It  is.  NIE  policy  that  when 
all  known  potential  sources  are  not  solicited,  the  project  officer  must 
justify  the  elimination  of  inadequate  ones  (NIE  Guide  No.  16.0.11, 
January  16,  1975,  p.  3).     Once  the  final  source  list  has  been  generated, 
if  all  potential  sources  are  not  solicited  and  if  the  procurement  will 
exceed  $300,000,  the  list  must  be  approved  by.  the  NIE  Contracts  and 
Grants  Review  Board  (NIE  Guide  16.0.04,  January  16,  1975,  p.  3). 

After  the  above  presolicitation  activities  have  been  completed ^  the 
description  of  the  statement  of  work  must  be  reviewed  and  approved  by 
an  RFP  review  group  (NIE  Guide  16.0.04,  January  16,  1975,  p. .2).  The 
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review  group  includes  ths  contracting  officer,  the  project  officer,  and 
one  or  more  individuals  from  outside  the  funding  office. 

After  approval  by  the  review  group,  the  project  officer  must  submit 
a  Funds  Commitment  Request  (FCR)  to  the  contracts  officer.     The  FCR  and 
requisite  attachments  "will  constitute  the  working  documents  upon  which 
the  contracting  officer  will  rely  in  the  exercise  of  his/her  responsi- 
bility and  authority  to  enter  into  and  administer  contracts  and  grants 
consistent  with  the  requirements  of  law  and  regulation"  (NIE  Guide  No. 
16.0.01,  January  16,  1975,  p.   1).     The  following  documentation  must  ac- 
comp'^ny  the  FCR: 

•  Statement  of  work/specif ication  ... 

•  Criteria  upon  which  evaluation  of  proposals  will  be 
predicated  . . . 

•  Detailed  estimate  of  costs  ... 

•  If  applicable,  a  listing  of  sources  ...    (NIE  Guide  No. 
16.0.01,  January  16,  1975;  p.  1). 

The  FCR  must  also  be  accompanied  by  applicable  approvals source  selec- 
tion list  approval  from  the  NIE  Contracts  and  Grants  Review  Board;  state- 
ment of  work  approval  by  the  RFP  review  board;  approval  by  the  Associate 
Director  of  the  funding  office  if  the  procurement  is  less  than  $300,000; 
approval  by  the  Deputy  Director  if  it  is  greater  than  .$300,000. 

The  contracting  officer  uses  the  FCR  and  attachments  to  prepare  the 
Request  for  Proposal.     The  RFP  has  two  purposes: 

•  To  convey  to  prospective  contractors  the  information 
needed  to  prepare  a  proposal. 

•  To  solicit  the  information  that  procurement  and  technical 
personnel  need  to  appraise  the  proposals  of  prospective 
contractors  (HEW,  July  1971,  p.  39). 
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Although  the  project  officer  is  In  the  best  position  to  describe  the  work 
that  is  needed,  only  the  contracting  officer  has  the  legal  authority  to 
request  a  proposal  (NIE  Guide  No.   16.0.10,  January  16,  1975,  p.  1). 

The  RFP  must  be  in  writing,  must  specify  a  deadline  for  proposal 
submission,  and  must  specify  that  any  questions  about  the  request  should 
be  referred  to  the  appropriate  contracts  officer.     The  RFP  must  include: 

...  the  terms,  conditions,  and  provisions  that  will  consti- 
tute the  final  definitive  contract,  and  specify  all  the  in- 
formation that  prospective  contractors  are  required  to 
furnish  to  permit  a  meaningful  and  equitable  evaluation  of 
their  offerors.     Criteria  for  evaluating  prospective  con- 
tractor proposals  will  be  stated  along  with  their  relative 
weights  (NIE  Guide  No.   16.0.10,  January  16,  1975,  p.  2). 

The  completion  of  the  RFP  concludes  the  presolicitat ion  phase. 

Solicitation  Phase--During  the  solicitation  phase,  distributing  the 
RFP,  answering  any  questions  from  prospective  offerors,  conducting  the 
conference  for  prospective  offerors  if  one  is  held,  and  receiving  and 
handling  proposals  are  all  responsibilities  of  the  contracting  officer. 
The  principal  goal  during  this  period  is  to  ensure  that  all  prospective 
offerors  receive  ''the  same  information,  and  [that]  no  action  should  be 
taken  which  might  give  one  organization  an  advantage  over  others'*  (NIE 
Guide  No.  16.0.10,  January  16,  1975,  p.  4).     The  deadline  for  receipt  of 
proposals  stipulated  in  the  RFP  marks  the  end  of  the  solicitation  phase 
(although  the  government  reserves  the  right  to  consider  late  proposals 
if  they  offer  considerable  advantage  to  the  government). 

Proposal  Evaluation  Phase — The  purpose  of  the  proposal  evaluation 
phase  is  to  select,  from  all  proposals  submitted,  those  that  represent 
the  competitive  range  in  terms  of  technical  quality  and  cost  for  pur- 
poses of  negotiation.     The  principal  steps  in  this  process  are  an  evalu- 
ation of  the  technical  quality  and  cost  factors  of  each  proposal,  and  a 
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determination  of  the  firms  or  firm  with  which  to  conduct  negotiations 
(NIE  Guide  No.   16.0.12,  January  16,  1975). 

The  technical  evaluation  of  proposals  is  performed  by  the  project 
officer  and  others  in  accordance  with  the  evaluation  criteria  stated  in 
the  RFP.     Both  the  proposed  work  and  the  offeror's  capabilities  are  as- 
sessed.    At  the  conclusion  of  the  technical  evaluation,  all  proposals 
should  be  ranked  in  order  of  technical  quality.     As  an  aid  in  the  rank-  • 
ing  process,  each  evaluation  criterion  should  be  assigned  a  weighting 
factor  based  on  the  relative  importance  of  the  criterion  to  the  project 
(NIE  Guide  No.   16.0.12,  January  16,  1975,  p.  2). 

The  cost  evaluation  is  performed  by  the  contracting  officer  working 
*'in  conjunction  with"  the  project  officer.     In  this  evaluation,  cost/ 
price  estimates  and  the  offeror's  financial  strength  and  management 
ability  are  assessed. 

The  synthesis  of  the  two  evaluations  yields  a  ranking  of  all  pro- 
posals on  both  technical  and  cost/price  grounds.     It  is  the  responsi- 
bility of  the  contract  officer  to  use  this  ranking  to  determine  the 
firms  or  firm  with  which  to  negotiate.     According  to  the  NIE  Guide,  the 
overriding  consideration  must  be,  "With  which  firms  will  the  conduct  of 
discussions  prove  meaningful?"     (NIE  Guide  No.   16.0.12,  January  16,  1975, 
p.   3.)     The  contract  officer  should  use  the  following  procedures  to  de- 
termine which  proposals  fall  within  the  competitive  range: 

•  Eliminate  ...  proposals  from  firms  ...  with  neither  the 
capacity  nor  credit  to  perform. 

•  Eliminate  technically  unacceptable  proposals. 

•  Eliminate  proposals  that  would  be  made  unacceptable  based 
on  the  probable  consequences  of  required  cost  reductions. 

•  Eliminate  proposals  that,  although  technically  acceptable, 
are  predicated  on  pricing  considered  excessive  when 


11-23 

79 


compared  with  proposals  of  equal  technical  scoring  and 
that  are  not  susceptible  to  the  conduct  of  meaningful 
negotiations  (NIE  Guide  No,   16.0.12,  January  16,  1975, 
p.  3). 

The  remaining  proposals  constitute  the  competitive  range.     Federal  Pro- 
curement Regulations  require  that  "written  or  oral  discussions  shall  be 
conducted  with  all  responsible  offerors  who  submitted  proposals  within 
a  competitive  range,  price  and  other  factors  considered"     (HEW,  July 
1971,  pp.  48-4?).- 

Negotiation  Phase--The  purpose  of  the  negotiation  phase  is  to  pro- 
cure the  contract  most  advantageous  to  the  government.     The  Comptroller 
General  has  determined  that  even  though  initial  proposals  may  have  been 
evaluated  as  acceptable,  this  does  not  invalidate  the  necessity  for  ne- 
gotiation (HEW,  July  1971,  p.  49).    Moreover,  the  Comptroller  General 
has  also  held  that  technical  superiority  cannot  be  the  sole  basis  for 
award  of  a  contract  under  a  negotiated  procurement  (HEW,  July  1971, 
p.  50),    Discussions,  led  by  the  contracting  officer,  arejheld  with  all 
offerors  within  the  competitive  range,  "predicated  on  the  proposal  de- 
ficiencies as  determined  during  the  [proposed]  evaluation"  (NIE  Guide 
No,  16.0.12,  January  16,  1975,  p.  3).     The  end  result  of  the  negotia- 
tion process  should  be  mutual  agreement  between  the  government  and  one 
offeror  (or  more  than  one  offeror  if  the  RFP  provided  for  multiple 
awards)  that  the  offeror  "can  perform  in  the  best  interest  of  the  Insti- 
tute, price  and  other  factors  considered"  (NIE  Guide  No.  16.0.12,-  Janu- 
ary 16,  1975,  pp^-  i-4). 

It  is  then  the  responsibility  of  the  contracting  officer  to  prepare 
the  contract  reflecting  agreements  reached  during  negotiations.  The 
contract  is  first  signed  by  the  contractor,  then  by  the  NIE  contract 
officer  (HEW,  July  1971,  p.  54). 
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■Postax^ard  Administration  Phase* -During  this  phase,  the  NIE  project 
officer  monitors  performance  in  accordance  with  the  terms  of  the  contract, 
provides  appropriate  technical  direction,  recommends  any  appropriate  cor- 
rective actions  to  the  contracting  officer  (for  example,  extensions,  ter- 
mination, or  modifications),  and  performs  final  review  and  acceptance  of 
the  services  or  products  delivered  under  the  contract.     After  final  re- 
view and  acceptance,  it  is  the  responsibility  of  the  contract  officer  to 
close  out  the  contract. 

Procurement  via  the  Grant  Instrument 

Many  of  the  considerations  for  grant  procurement  are  similar  to 
those  for  contract  procurement.     Competition  is  encouraged,  all  appli- 
cants must  be  evaluated  uniformly,  and  there  may  be  negotiation  of  bud- 
gets for  the  competitive  range  of  applicants.     One  major  difference  is 
that,  whereas  the  regulations  for  procurement  by  contract  are  written  by 
the  General  Services  Administration  and  therefore  are  fairly  uniform 
across  all  civilian  agencies,  the  regulations  for  the  award  of  grants 
are  written  by  individual  agencies.    Proposed  grant  regulations  must  be 
published  in  the  Federal  Register  to  allow  for  review  and  comment  by  any 
interested  parties.     This  publication  requirement  applies  both  to  gen- 
eral regulations  governing  all  grant  competitions  and  to  program-specific 
regulations,     A  second  major  difference  is  that  the  scope  of  work  is  usu- 
ally much  less  precisely  specified  in  a  Grant  Announcement  than  in  a  RFP, 

Award  and  administration  of  grants  require: 

•  Public  notice  of  gr£int  programs  through  publication  of 
program  specific  regulations  in  the  Federal  Register, 

•  Solicitation  of  applications  or  proposals  through  pro- 
gram announcements, 

•  Establishment  of  firm  cutoff  dates  for  receipt  of 
applications /proposals /prospectuses , 
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Uniform  evaluation  procedures  for  all  applications/ 
proposals /prospectuses  ^ 

Negotiation  of  budgets  based  on  analysis  of  reasonable- 
ness of  budget. 

Approval  of  award  slate  by  Deputy  Director  or  Director, 

Individual  grant  actions  awarded  noncompetitively  to  be 
justified  and  approved  in  the  same  manner  as  noncompeti 
tive  contracts  (NIE  Guide  No.  16.0.07,  January  16,  1975 
p.  2). 
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IV    POLICY  IMPLICATIONS  FOR  EKPU.  SYSTEM 
USING  THE  ANALYTIC  FRAMEWORK 


Sections  II  and  III  described  the  components  of  NIE's  procurement 
system:     the  major  sources  of  policy  influencing  NIE's  procurement  of 
education  R&D,  the  major  policies,  the  agents  who  enforce  those  policies 
and  the  decisions  and  activities  necessary  to  implement  the  policies. 
In  this  section  we  attempt  to  describe^and  assess  some  of  the  inter- 
actions among  agents,  policies,  and  activities. 

Structural  Interaction 

The  two  principal  agents  in  procuring  education  R6cD  are  the  project 
officer  and  the  contracting  officer.     Within  NIE  (as  is  the  case  with 
most  government  agencies),  the  project  officer  and  the  contracting  offi- 
cer are  in  different  portions  of  the  organization  (see  Figure  II-5).  As 
a  result  of  this  structural  placement,  the  two  principal  agents  in  any 
procurement  action  report  to  different  superiors,  have  different  col- 
leagues, different  norms,  and  different  paths  for  career  advancement. 
Yet  the  ease  with  which  they  communicate  with  one  another  and  the  qual- 
ity of  their  communication  influence  the  entire  procurement  process. 

Consideration  of  structural  interaction  raises  several  interesting 
questions.     The  most  obvious  is:     What  are  the  communications  patterns 
between  project  officer  and  contracting  officer?    This  question  has 
several  components: 

•  How  do  patterns  vary  across  individuals? 

•  How  do  they  vary  across  stages  of  the  procurement  process? 

•  How  do  they  vary  across  time  within  and  across  stages  of 
the  procurement  process? 
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FIGURE  11-5    NIE  ORGANIZATION  FOR  R&D  PROCUREMENT  AND  ADMINISTRATION 
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•  Is  it  possible  to  identify  specific  ''areas  of  ignorance" 
for  either  the  project  officer  or  contracting  officer  that 
have  a  negative  impact  on  their  communication  during  the 
procurement  process? 

It  is  interesting  to  note  that  even  though  NIE's  procurement  pro- 
cess requires  the  cooperation  of  the  project  officer  and  the  contracting 
officer,  neither 's  performance  is  evaluated  by  the  other  or  the  other's 
superior.     Thus  it  might  be  useful  to  determine  the  effect  of  personnel 
evaluation  policies  upon  the  procurement  process;  for  example: 

•  What  criteria  does  the  agent's  superior  employ  in  assess- 
ing the  agent's  performance  with  respect  to  procurement? 

•  What  criteria  would  the  contract  officer's  superior  wish 
to  employ  in  evaluating  the  project  officer? 

•  What  criteria  would  the  project  officer's  superior  wish 
to  employ  in  evaluating  the  contract  officer? 

Review  and  Sign-Off  Interaction  with  Different  Variables 

Between  the  project  officer'?  initial  idea  for  a  procurement  action 
and  the  contract  G-£ficer's  closeout  of  a  completed  contract,  there  are 
a  number  of  points  at  which  actions  or  decisions  must  be  reviewed  or  ap- 
proved by  various  NIE  authorities  (see  Figure  11^6).     The  level  of  re- 
view and  sign -off  varies  according  to  at  least  three  variables:     size  of 
award,  type  of  competition,  and  procurement  instrument  (contract  or 
grant).    Variation  in  the  level  of  review  and  sign-off  is  also  related 
to  the  amount  of  time  necessary  to  complete  each  step  in  the  procure- 
ment process. 

It  would  be  useful  to  have  reasonable  time  estimates  for  the  vari- 
ous activities  represented  in  Figure  II-6.     Then  it  would  be  possible  to 
answer  trade-off  questions  such  as  the  following: 

•  Which  "costs"  more  time:     a  contract  procurement  or  a 
grant  procurement? 
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•  In  choosing  a  competitive  or  noncompetitive  procurement 
action,  which  "costs"  more  in  the  eyes  of  the  project 
officer:     the  time  it  takes  to  process  a  competitive 
procurement,  or  the  level  of  sign-off  and  justification 
necessary  for  a  sole-source  procurement? 

•  What  are  the  trade-offs  between  time  and  justification  in 
choosing  open  or  limited  contract  competition?     (This  ques- 
tion identifies  an  apparent  anomaly  in  NIE  procurement 
policy.     The  preferred  policy  is  to  use  limited  rather  than 
open  competition  for  contracts  (NIE  Guide  No,  16.0,11). 
Yet,   if  competition^is  limited,  the  project  officer  must 
justify  the  elimination  of  sources  considered  inadequate 
and,  if  the  procurement  is  greater  than  $300,000,  must  ob- 
tain approval  of  the  source  list  from  the  Contracts  and 
Grants  Board.     Thus  it  would  seem  that  the  preferred  pol- 
icy demands  more  effort  than  the  nonpref erred  policy.) 


NIE  Interaction  with  the  Field 

At  the  same  time  that  the  procurement  policies  create  a  number  of 
•interaction  points  for  various  agents  within  -NIE,  they  also  create  inter 
action  points  between  NIE  andT.  the  "field,"  i.e.,  the  performers  of  edu- 
cation R6cD  who  may  be  potential  offerors  for  any  particular  procurement 
activity  (see  Figure  II-7) .     The  character  of  those  interactions  most 
certainly  Influences  the  quality  of  any  procurement. 

Because  publication  of  Commerce  Business  Daily  synopses  is  the  stan 
dard  method  of  soliciting  offerors  according  to  the  procurement  regula- 
tions,  it  would  be  interesting  to  know:     What  proportion  of  proposals  to 
NIE  are  generated  as  a  result  of  that  process?    What  kinds  of  potential 
offerors  do  or  do  not  read  Commerce  Business  Daily?    How  muchjioes  it 
cost  a  firm  (and  thereby  the  government ,  via  overhead  costs)  to  support 
a  Commerce  Business  Daily  monitoring  capability?     If  responses  to  synop- 
ses do  not  constitute  the  majority  of  names  on  any  particular  list  of 
sources  sought,  how  are  the  names  generated?    What  is  the  relationship 
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between  the  manner  in  which  a  source  is  solicited  and  the  later  awarding 
of  a  contract? 

Once  the  RFP  has  been  sent  to  the  field,  undoubtedly  a  number  of 
factors  influence  which  potential  offerors  actually  submit  proposals. 
Within  the  context  of  the  formal  regulations,  however  (i.e.,  excluding 
the  technical  quality  of  the  RFP),  one  of  the  most  important  variables 
is  probably  the  amount  of  time  allowed  for  an  offeror  to  submit  a  pro- 
posal.    What  is  the  relationship  between  allowed  response  time  and  the 
number  of  proposals  submitted?    What  is  the  relationship  between  allowed 
response  time  and  characteristics  of  the  offeror? 

Areas  of  Discretion 

To  this  point  we  have  attempted  to  delineate  only  those  decisions, 
activities,  and  interactions  prescribed  by  formal  procurement  policies. 
However,  one  of  the  important  characteristics  of  procurement  policies 
and  regulations  is  that,  despite  their  codified  and  mandatory  provisions, 
they  provide  large  areas  of  discretion  for  the  project  officer.     In  most 
cases  these  areas  of  discretion  may  have  greater  impact  on  the  procure- 
ment process  and  its  outcomes  than  do  the  formally  prescribed  activities. 
Here  we  can  do  no  more  than  point  out  some  of  the  most  important  areas 
of  discretion  and  suggest  some  of  their  components.     A  thorough  analysis 
of  each  of  these  areas  would  be  appropriate  for  a  second-generation  re- 
search project  growing  out  of  the  work  accomplished  thus  far. 

In  Figure  II-4  we  presented  a  simplified  decision  tree  of  the  pro- 
curement process,  indicating  at  each  node  the  policy-preferred  branch. 
In  almost  all  situations,  every  node  and  every  branch  of  that  tree  pro- 
vides an  area  of  discretion  for  the  project  manager  (see  Figure  II-8). 
For  most  procurement  actions,  the  discretionary  activities  are  governed 
by  a  combination  of  individual  judgement  and  agenc3rwide  R6cD  management 
philosophy  or  style. 
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Making  the  decision  between  field  initiation  or  NIE  initiation  of 
a  procurement  action  depends  to  a  large  extent  on  the  level  of  capabil- 
ity , and  interest  in  the  field,  but  it  also  depends  on  the  management 
philosophy  adopted  by  the  agency.     To  what  extent  does  the  agency  see 
itself  as  a  '^directive*'  manager?    Making  the  decision  between  an  intra- 
mural or  extramural  performer  depends  on  the  locus  of  expertise  and  the 
extent  to  which  the  agency  considers  it  "important"  to  develop  its  in- 
ternal research  capability.     Problem  definition  is  probably  the  most 
important  area  of  discretion.     The  decision  who  should  have  this  discre- 
tion determines,  in  many  cases,  whether  a  grant  or  contract  procedure 
should  be  used.     It  determines  whether  a  competitive  or  noncompetitive 
procurement  should  be  employed.     It  influences  the  composition  of  the 
sources-sought  list.     It  affects  the  quality  of  proposals  received  from 
the  field  and  the  procedures  and  criteria  used  to  evaluate  them.  Nego- 
tiation, contract  or  grant  award,  and  monitoring  also  entail  discretion- 
ary activities  on  the  part  of  the  project  officer.     (See  Biderman  and 
Sharp  [1972]   for  a  discussion  of  areas  of  discretion  in  the  procurement 
process  within  the  context  of  procuring  social  program  evaluation  re- 
search. ) 

To  better  understand  the  areas  of  discretion  within  the  procure- 
ment process,   it  would  be  helpful  to  have  an  adequate  description  of 
NIE's  R6cD  management  philosophy.     It  would  also  be  helpful  to  attempt  to 
understand  relationships  among  various  project  officer  characteristics 
and  outcomes  in  areas  of  discretion.     One  might  wish  to  examine  the  pro- 
ject officer's  prior  procurement  experience  (within  NIE  or  other  govern- 
ment  agencies),  his  or  her  level  and  degree  of  professional  association 
with  the  field,  his  or  her  relationship  with  the  contracting  officer, 
and  so  on.     It  would  also  be  useful  to  understand  limits  to  the  areas  of 
discretion--f or  example,  the  role  of  deadlines. 
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Annex 

TAXONOMY  OF  POLICIES  CONSIDERED  SIGNIFICANT  IN  THE  STUDY 
OF  FEDERAL  COMPETITIVE  PROCUREMENT  POLICIES 
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I  INTRODUCTION 

Policies  that  control  the  availability  of  information  are  always  of 
concern  in  a  free  society.     They  are  of  particular  significance  to  a 
field  of  inquiry  such  as  knowledge  production  and  utilization  (KPU) ,  where 
information  is,  by  definition,  its  most  precious  resource.     It  is  there- 
fore important  that  suitable  methods  and  information  bases  be  available 
through  which  to  assess  the  impact  that  such  policies  might  have  on  the  ^ 
KPU  infrastructure.     The  capability  to  conduct  a  policy  impact  assessment 
appears  especially  needed  in  KPU  because  of  the  recent  "Buckley  Amendment," 
which  would  make  research  access  to  student  records  difficult  under  many 
circumstances. 

Because  the  art  of  policy  impact  assessment  has  not  been  well- 
developed,   the  objectives  of  this  case  topic  are  essentially  twofold: 
to  explore  the  utility  of  the  analytical  framework  for  helping  assess  the 
impacts  of  given  policies  on  educational  KPU  (EKPU) ,   and  to  derive  pre- 
liminary implications  (including  information  requirements)  for  a  monitor- 
ing system- 
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II    FORMAL  ASSESSMENT  OF  POLICY  IMPACTS 


Although  policy  impact  assessment  has  not  yet  become  a  generally 
recognized  analytical  procedure  within  the  field  of  policy  science,  we 
may  infer  a  number  of  characteristics  it  would  have,  based  on  what  is 
known  about  how  to  assess  probable  impacts  of  new  technologies  ("tech- 
nology assessment").     Although  technology  and  policy  differ  along  many 
dimensions,  their  assessment  has  in  common  the  necessity  to  consider 
social,   economic,  and  political  implications  beyond  those  intended. 

The  questions  that  typically  need  to  be  addressed  in  a  formal  impact 
assessment  are  the  following  (Keifer,  1973;  Kasper,   1972;  Coates,  1972; 
Quade,  1975): 

•  How  will  this  development  (that  is,  this  technology, 
activity,  or  policy)  be  used? 

•  What  consequences,  direct  or  indirect,  for  good  of  ill,  will 
these  applications  have  on  any  or  all  sectors  of  the  society 
or  the  environment? 

•  What  responses  can  be  expected  in  other  areas? 

•  How  do  the  desirable  results  balance  against  those  that  are 
undesirable  or  uncertain? 

•  Are  the  effects  reversible  in  the  short  term  or  the  long 
term? 

•  What  alternatives  might  achieve  the  sane  results? 

In  general,  the  process  of  answering  these  questions  entails  a 
series  of  steps  that  resemble  the  systems  method  (Conimittee  on  Public 
Engineering  Policy,  1969): 


A  list  of  references  is  appended  to  this  case  study. 


III-3 


•  Identify  the  innovation  (technology,  policy,  or  the  like) 
to  be  assessed. 

•  Delineate  the  scope  of  the  assessment  and  establish  a  data 
base. 

•  Identify  alternative  actions. 

•  Identify  agents  affected  by  the  problem  and  by  the  innovation. 

•  Identify  the  impacts  on  the  affected  parties. 

•  Valuate  or  measure  the  impacts. 

•  Compare  the  pros  and  cons  of  alternatives  (analysis). 

•  Draw  conclusions. 

In  any  specific  assessment,  however,  not  all  of  the  above  steps  may  be 
necessary.     The  specific  steps  that  are  needed  depend  both  on  the  scope 
and  the  depth  of  the  assessment  and  on  the  general  approach  through  which 
it  is  conducted. 

Regardless  of  the  scope  of  the  assessment  and  the  approach  used, 
however,  the  following  three  types  of  information  are  generally  required 
and  can  be  obtained  at  least  in  a  preliminary  fashion  from  the  policy 
being  assessed: 

•  Specification  of  the  basic  purpose  of  the  policy,  which 
typically  includes  identification  of  the  target  population 
(agents,  activities,  or  configurations)  whose  interests 
would  be  most  directly  influenced  by  the  policy. 

•  Specification  of  the  agents  who  have  some  responsibility 
called  out  in  the  policy  statements  themselves,  typically 
those  who  are  to  interpret,  implement,  enforce,  and  comply 
with  the  intent  of'  the  given  policy. 

•  Some  idea  of  the  predominant  activities  through  which  the 
policy  will  be  implemented  (extent,  time,  place,  and  the 
like). 
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Ill    FIVE  POLICIES  THAT  CONTROL  THE  AVAILABILITY  OF  INFORMATION 


A  variety  of  policies  control  or  significantly  influence  access  to 
information  in  KPU.     Five  such  policies  possibly  warranting  impact  assess 
ment  are  the  following: 

•  Public  Law  93-380,  Section  438,  "Buckley  Amendment."  This 
law  in  part  deals  with  the  protection  of  the  rights  of 
privacy  of  parents  and  students  concerning  access  to  student 
files  by  researchers. 

•  Public  Law  93-579,  "Privacy  Act  of  1974."    This  law  deals 
with  the  protection  and  safeguarding  of  an  individual's 
privacy  from  the  misuse  of  federal  records  by  individuals 
and  the  government. 

•  Public  Law  93-502,  "Freedom  of  Information  Act  of  1974." 
This  act  deals  primarily  with  the  kinds .of  information  that 
must  be  made  available  to  the  public  from  the  federal 
agencies. 

•  Copyright  regulations  authorizing  protection  for  materials 
developed  under  NIE  grants  and  contracts. 

•  Federal  Reports  Act  of  1942  and  Office  of  Management  and 
Budget  (0MB)  Circular  No.  A-40.     These  established  policies 
that  control  the  kinds  of  information  that  may  be  collected 
by  the  federal  agencies,   either  through  the  agency  or  through 
a  grantee  or  contractor. 

In  a  formal  impact  assessment,   each  of  these  policies  would  need  to  be 
"broken  out"  in  some  detail  to  reveal  their  explicit  and  predotninant 
purposes,  agents,  and  activities.     This  would  entail  not  only  the  speci- 
fication of  differing  purposes/ agents/activities  within  a  given  policy, 
but  also  the  examination  of  various  "levels"  of  policy  as  well.  For 
instance.  Table  III-l  illustrates  the  types  of  policies  that  should  be 
consulted  because  they  specify  agents  who  would  need  to  be  considered 
in  a  policy  impact  assessment. 
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Table  III-2  indicates  the  types  of  agents  that  are  cited  in  various 
sources  of  policy  related  to  the  Buckley  Amendment.     Tables  III-l  and 
III-2  together  indicate  that  formal  impact* assessments  of  policies  such 
as  the  five  cited  would  need  to  include  a  fairly  careful  analysis  of 
various  sources  of  policy.     Such  assessments  could  be  extremely  compli- 
cated when  the  relevant  policies  differ  at  the  state  level,  or  the  local 
level,  or  both  levels. 
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IV    ALTERNATIVE  APPROACHES  TO  POLICY  IMPACT  ASSESSMENT 


A  canon  of  decision  analysis  is  that  there  is  a  point  beyond  which 
the  gathering  of  additional  information  provides  decreasing  assistance 
(relative  to  its  cost)  in  making  a  decision.     The  cost  of  obtaining 
(and  analyzing)  varying  amounts  of  information  relative  to  the  impact  of 
a  given  policy  must  be  carefully  considered  because  formal  analytical 
approaches  to  impact  assessments  are  so  costly.     To  gain  perspective 
regarding  the  amount  of  information  that  a  monitoring  system  might  need 
for  policy  impact  assessments  in  KPU,  one  might  consider  the  amount  of 
information  needed  to  assess  the  significant  primary  and  higher  order 
impacts    of  the  Buckley  Amendment. 

•    In  brief,  the  main  purpose  of  the  Buckley  Amendment  (PL  93-380, 
Section  438)  is  to  allow  access  of  parents  and  students  to  student  records 
maintained  by  educational  institutions  and  agencies  receiving  federal 
program  monies,  and  to  control  the  release  of  such  records.     Because  of 
its  specific  impact  on  the  KPU  infrastructure,  we  wish  to  focus  on  that 


By  first-order  impact  is  meant  the  effects  that  are  directly  intended 
by  the  policy  (for  example,  in  the  Buckley  Amendment,  the  protection  of 
student  files).     Two  significant  second-order  impacts  might  be  that 
various  KPU  workers  could  no  longer  gain  the  necessary  access  to 
important  data  archives  (for  example,   for  unbiased  selection  of  data 
series  for  longitudinal  studies)  and  that  the  improvement  of  public 
education  would  thereby  suffer.     Examples  of  third-order  effects  might 
be  subsequent  lobbying  to  have  this  law  changed  or  the  creation  of  some 
new  file  not  subject  to  the  Buckley  Amendment  as  interpreted,  which 
would  bring  a  whole  'new  set  of  influences  to  KPU.     We  believe  that 
second-  and  first-order  impact  assessments  require  tools  that  are 
similar  in  function  to  the  analytical  framework  we  have  developed,  if 
the  assessments  are  to  be  at  all  rigorous  in  a  rational/ analytic  sense. 
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part  of  the  law  dealing  with  access  to  student  records  [20  U,S,C,, 
Sections  1232g  (b)(1)  through  (b) (3)--see  Table  III-3],  and  on  the  re- 
quirement that  researchers--unless  they  are  the  authorized  representa- 
tives of  certain  officials  for  purposes  of  auditing  or  evaluating 
federally  supported  education  prograins--must  obtain  permission  from  all 
parents  of  students  whose  records  are  to  be  used  for  research  purposes. 
(Because  the  regulations  and  guidelines  for  this  law  were  unavailable  at 
the  time  of  research  on  this  topic,  we  will  use  this  somewhat  over- 
simplified version  of  the  Buckley  Amendment  for  the  purposes  of  this  case 
topic.) 

There  are  four  approaches  one  might  take  to  develop  information 
necessary  for  an  impact  assessment  of  a  national- level  KPU  policy.  In 
order  of  increasing  demand  for  information  that  would  be  produced  by  a 
monitoring  system,  the  alternative  approaches  are  as  follows: 

•  Alternative  One- -Without  regard  to  specific  numbers  of  agents 
and  activities,  infer  the  ptobable  macroeffects  on  the  whole 
system  and  on  specific  parts  of  the  system,  based  on  prior 
knowledge  of  the  system  and  one's  intuition.     This  approach 
could  include  group  consensus  techniques,  such  as  the  Delphi 
or  the  cross- impact  matrix. 

•  Alternative  Two--Based  on  existing  information  Xn  the  DATA- 
BOOK  or  other  sources,  estimate  the  minimum  numbers  of 
agents  and  activities  to  be  impacted  as  a  provisional  data 
base  to  use  with  whatever  impact  assessment  method  Is 
selected. 

•  Alternative  Three* ^Conduct  an  ad  hoc  survey  of  selected 
agents/ activities  to  make  possible  an  accurate  estimate  of 
the  information  guessed  at  in  Alternative  Two,  and  conduct 
a  somewhat  more  formal/ rigorous  assessment  than  would  be 
suitable  in  Alternative  Two. 

•  Alternative  Four — Conduct  one  or  more  general'  data  collec- 
tions for  subsequent  editions  of  the  DATABOOK,  so  that  iniuch 
more  detailed  and  comprehensive  information  describing  the 
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numbers  and  types  of  agents  and  activities  that  character- 
ize the  KPU  infrastructure  would  be  available  for  many 
purposes- -including  policy  impact  assessment. 

Each  of  these  alternatives  relative  to  the  Buckley  Amendment  is  discussed 
below. 

Alternative  One 

At  the  simplest  level,  one  would  reflect  on  possible  major  conse- 
quences of  the  amendment.     For  example,  one  could  speculate  on  the  impact 
of  having  to  obtain  1007o  parental  consent  to  obtain  information  from  - 
student  records  for  research  purposes,  even  though  no  personally  identi- 
fiable information  were  being  extracted  from  the  records.     Securing  1007o 
permission  would  be  difficult  in  most  instances,  but  failing  to  obtain 
100%  permission  would  contribute  an  unknown  bias  to  the  results,,  since 
willingness  to  grant  permission  is  almost  certainly  correlated  with  other 
variables  of  interest. 

Similarly,  one  can  reason  that  if  only  government  agents  or  their 
contractors  or  grantees  who  are  specifically  evaluating  a  governmental 
program  have  access  to  student  records,  then  only  those  researchers  who 
work  under  governmental ly  imposed  constraints  (for  example,  the  RFP/contract 
mode  of  procurement  discussed  in  Case  Study  II)  will  have  access  to  an  im- 
portant class  of  information.     This  would  bring  our  society  one  step  closer 
to  what  policy  analyst  Bertram  Gross  (1970)  termed  "friendly  fascism"--ei 
scenario  in  which  management  of  information  technology  is  one  of  several 
techniques  used  by  a  "technocratic  bureaucracy"  to  maintain  a  nonrepresen- 
tative  type  of  governance. 

At  a  more  detailed  level  of  system  operation,  it  is  difficult  to 
estimate  the  significant  impacts  without  knowing  more  about  which,  agents* 
and  activities  would  be  most  affected.    Therefore,  we  turn  to  Alternative 
Two. 

Ill- 12  ' 


Alternative  Two 

In  this  alternative,  the  emphasis  is  on  making  rapid  estimates  with- 
out additional  data  collection.     The  approach  is  to  obtain  the  best 
estimate,  however  inaccurate,  of  the  minimum  numbers  and  types  of  agents 
and  activities  to  feel  the  impacts  of  the  Buckley  Amendment. •  This  in- 
formation would  then  be  used  in  an  assessment  that  might  be  more  or  less 
quantitative  and  more  or  less  extensive  in  scope  and  depth. 

The  first  step  is  to  examine  the  basic  policies  that  specify  how 
the  Buckley  Amendment  is  to  be  implemented  and  so  determine  the  relevant 
agents  and  activities.     Table  III- 3  lists  the  most  significant  agents 
who  have  specifically  assigned  responsibilities  in  this  regard,  and 
Table  III-2  identifies  the  range  of  agents  who  were  cited.     For  simplifi- 
cation, we  will  consider  only  contractors  and  grantees  of  the  Education 
Division-- that  part  of  the  KPU  work  force  usually  thought  of  as  R&D  pro- 
fessionals.    The  central  question  is:     Under  the  Buckley  Amendment,  how 
many  such  professionals,  engaging  in  what  activities,  would  find  it 
necessary  to  spend  how  much  time  (hence  money)  obtaining  fhe  necessary 
permission  to  use  student  files  and,  consequently,  what  types  of  research 
might  become  infeasible? 

Indicators  relevant  to  this  question  are  to  be  found  in  the  recently 
published  DATABOOK  (National  Institute  of  Education,  1975)  and  are  discuss 
below,  *  . 

Several  indicators  apply  to  persons  working  in  the  field;  for  example 

•  In  1966,  17,000  names  were  found  in  the  education  publica- 
tions, 

•  In  1974,  the  American  Education  Research  Association  had 
10,836  members, 

•  Ten  percent  of  all  doctorates  in  education  are  in  R&D. 

•  The  mean  estimate  of  the  R&D  work  force  in  education,  is 
*10,000, 


Without  knowing  what  type  of  work  these  persons  do,  however,  it  is  not 
possible  to  estimate  the  impact  that  the  Buckley  Amendment  might  have  on 
them. 

Under  the  most  liberal  interpretations  of  this  policy,  one  might  con- 
clude that  officials  of  all  local  and  state  education  agencies  would  be 
exempt  from  the  requirement  to  obtain  parental  permission,  but  that  all 
other  researchers--unless  they  were  evaluating  the  effectiveness  of  a 
congressionally  mandated  program- -would  have  to  seek  this  permission. 
Some  indications  do  exist  of  the  size  of  the  latter  group  and  of  the 
types  of  projects/ products  that  would  be  impacted.     For  example,  present 
NIE  support  to  various  types  of  institutions  is  as  follows: 

•  State  and  local  governments,  67o 

•  Colleges  and  universities,  297o 

•  Nonprofit  and  for-profit  organizations,  607o 

•  Individuals  and  others,  57o. 

Recent  RScD  programs  cited  by  the  DATABOOK  as  having  had  "exemplary  out- 
comes" are  listed  below.     We  suspect  that  evaluating  the  outcomes  of 
these  programs  required  gaining  access  to  test  scores  of  individual 
students  by  using  methods  not  feasible  under  the  conditions  of  the  Buckley 
Amendment. 

•  Arithmetic  Proficiency  Training  Program,  Science  Research 


Associates  of  IBM. 


Cluster  Concept  Program,  University  of  Maryland. 


Creative  Learning  Group  Drug  Education  Program,  Media 
Engineering  Corp.,  Cambridge. 


Distar  Instruction  System,  University  of  Oregon, 


4 


Edison  Responsive  Environment,  McGraiw  Edison  Cprp, , 
Englewood  Hills,  New  Jersey, 

Facilitating  Inquiry  in  the  Classroom,  Northwest  Regional 
Education  Lab,  Oregon, 
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•  Frostig  Program  for  Perceptual-Motor  Development,  Frostig 
Center  of  Educational  Therapy,  Los  Angeles. 

•  Individually  Prescribed  Instruc tion--Math,  Learning  R&D 
Center,  Pennsylvania. 

•  Multi-Unit  School/Individually  Guided  Education,  R6cD  Center 
of  Cognitive  Learning. 

•  Science  Curriculum  Improvement  Study,  University  of 
California,  Berkeley. 

Taba  Social  Studies  Curriculum,   San  Francisco  State 
University. 

Perhaps  someone  more  familiar  with  the  details  of  educational  R&D  in 
the  United  States  could  translate  this  information  into  estimates  of  the 
numbers  and  types  of  agents  and  activities  whose  efforts  would  be  signifi- 
cantly hindered  by  the  Buckley  Amendment,  bvat  we  cannot.     Therefore,  except 
as  noted  below,  we  do  not  find  the  DATABOOK  information  adequate  for  our 
present  task. 

Alternative  Three 

Although  the  DATABOOK  information  provided  little  insight  about 
agents  and  activities  likely  to  be  hindered  by  the  Buckley  Amendment,  it 
provided  a  good  starting  point  from  which  to  sample  in  a  survey.     If  the 
above  agents  and  activities  represent  a  relatively  complete  listing  of 
the  major  agents  and  activities  that  currently  characterize  EKPU,  then 
the  listing  is  a  realistic  universe  from  which  to  select  samples  for  a 
survey  that  would  inquire  directly  about  the  impacts  in  question.     Such  a 
survey  might  determine  recent  research  that  necessitated  access  to  student 
records,   the  nature  of  the  use  of  student' records,  and  the  purposes  for 
which  the  research  outcomes  were  used.     The  same  information  could  be 
sought  for  research  anticipated  in  the  near  future.  % 
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One  could  then  tabulate  the  results  in  various  ways  or  investigate 
the  ramifications  of  possibly  significant  impacts  by  procedures  of  the 
analytical  framework,  such  as  we  have  developed  in  this  study. 

Alternative  Four 

In  contrast  to  a  survey  specifically  oriented  to  impacts  caused  by 
one  specific  policy  (discussed  in  Alternative  Three),  a  much  more  general 
survey  might  be  conducted.    A  general  survey  would  attempt  a  description 
of  the  KPU  infrastructure  that  would  make  special  purpose  surveys  unneces- 
sary.    Thus,   for  example,  one  might  envision  a  monitoring  system  that 
would  periodically  gather  information  about  the  KPU  infrastructure-- the 
numbers  and  types  of  agents,   the  activities,  and  the  resources  that 
typify  that  infrastructure.     This  would  require  a  relatively  elaborate 
taxonomy  of  agents,  purposive  activities,  and  possibly  even  KPU  processes 
(for  example,  evaluation  research). 
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V  RECOMMENDATIONS 


Although  this  has  been  a  brief  and  only  provisional  look  at  informa- 
tion needs  for  policy  impact  assessment  in  EKPU,  we  believe  that  some 
useful  and  valid  conclusions  can  be  drawn. 

First,  Alternative  Four  is  almost  certainly  not  feasible.     It  would 
be  prohibitively  expensive  when  compared  with  other  NIE  priorities.  More- 
over, our  experience  in  this  study  indicates  that  a  general  purpose  mapping 
of  the  KPU  instructive  using  an  agent/ activity  taxonomy  that  is  simple 
enough  to  be  usable  leaves  out  too  much  detail  to  be  useful;  correspond- 
ingly, if  sufficiently  detailed,  it  falls  under  its  own  weight.     On  the 
basis  of  this  finding,  we  recommend  that  a  generalized  survey  of  the  KPU 
infrastructure  that  is  sufficiently  detailed  to  cover  the  information 
needs  of  a  ''Buckley  Amendment  policy  impact  assessment"  not  be  seriously 
considered. 

Whether  a  survey  such  as  was  considered  under  Alternative  Three 
should  be  sponsored  depends  largely  on  the  amount  of  resources  that  NIE 
could  devote  to  a  given  impact  assessment  and  on  the  type  of  results  that 
would  fulfill  their  purposes  in  sponsoring  the  assessment.     For  example, 
assume  that  a  major  reason  for  sponsoring  an  assessment  of  the  impacts 
of  the  Buckley  Amendment  would  be  to  demonstrate  to  the  Congress  that 
it  works  a  hardship  on  the  KPU  community.     If  one  believed  that  the 
Congress  would  seriously  consider  the  unsubstantiated  opinions  of  the 
KPU  community  or  other  "experts,"  then  the  most  economical  way  to  proceed 
would  be  to  use  some  variation  of  Alternative  One--possibly  a  Deilphi 
survey  coupled  with  a  cross- impact  procedure  (Gordon  and  Becker,  1973) • 
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If  the  Congress  requires  tangible  evidence  of  hardships  and  specific 
stakeholder  groups  who  do  or  do  not  want  the  current  policy  changed,  then 
it  would  probably  be  necessary:     (1)  to  sponsor  a  survey  (either  large 
or  small)  that  would  identify  the  range  and  types  of  agents  and  activities 
in  KPU  that  would  experience  a  fairly  direct  impact;   (2)  to  use  the  ana- 
lytical framework  we  have  developed,  or  a  similar  method,   to  determine  the 
specific  configurations  in  KPU  that  would  be  most  severely  hampered;  and 
(3)  to  present  specific  and  detailed  listings  of  actual  or  probable 
impacts  that  can  be  strongly  defended  as  harming  EKPU. 

Although  the  analytical  framework  cannot  be  helpful  in  deciding 
whether  or  not  to  sponsor  an  assessment  of  the  Buckley  Amendment's  impacts 
on  EKPU,   it  would  be  helpful  in  making  such  an  assessment  in  a  rigorous 
and  economical  way. 

Because  the  Buckley  Amendment  could  have  enormous  impacts  on  the 
"health"  of  educational  KPU  and  because  the  relative  newness  of  impact 
assessment  as  an  analytical  art  does  not  permit  much  precision  in  select- 
ing the  best  method  of  assessment,  we  recommend  that  NIE  sponsor  a  brief 
feasibility  study.     If  staged  as  the  first  phase  of  a  larger  study,  a 
brief  initial  study  might  lead  eventually  to  a  useful  assessment  of  the 
impact  of  the  Buckley  Amendment  on  EKPU.     Moreover,  such  an  empirical  in- 
quiry would  give  insight  to  the  data  requirements  in  general  for  policy 
impact  analysis. 
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TAXONOMY  OF  POLICIES  CONSIDERED 
SIGNIFICANT  IN  THE  AVAILABILITY  OF  INFORMATION 
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I  INTRODUCTION 

The  Elementary  and  Secondary  Education  Act  (ESEA)  of  1965  inaugurated 
a  unique  experiment  in  U.S.  education  that  led  to  the  establishment  of  a 
series  of  research  and  development  (R&D)  centers  and  regional  laboratories 
around  the  country.     This  legislation  created  a  new  educational  agent  for 
which  there  was  no  prototype.     Operating  in  the  enthusiasm  that  attended 
the  passage  of  ESEA,.  the  U.S.  Office  of  Education  (USOE)  hastened  to  the 
task  of  creating  the  laboratories  and  centers.     Within  the'  next  two  years, 
20  regional  laboratories  sprang  up,   11  R&D  centers  (some  of  which  had  been 
created  earlier),  and  several  other  agencies  as  well.     This  operation  was 
noteworthy  not  only  for  its  scope  and  the  speed  with  which  it  was  mounted, 
but  also  for  its  unprecendented  nature.     This  was  institution-building  with 
only  the  broadest  of  guidelines  relative  to  the  mission,  the  organization, 
or  the  operation  of  these  novel  educational  agents. 

It  is  probably  too  early  for  a  definitive  assessment  of  this  chapter 
in  the  history  of  American  education.     However,  a  decade  has  passed,  the 
laboratories  and  centers  have  undergone  a  number  of  significant  changes, 
and  some  scrutiny  of  this  R&D  performer  is  appropriate.     A  full-scale  ex- 
amination of  the  laboratories  and  centers  was  beyond  the  scope  of  this 
project,   so  we  selected  one  example  for  analysis"the  Far  West  Laboratory 
(FWL).     We  chose  FWL  not  because  it  is  representative  of  all  the  labora- 
tories and  centers,  but  because  it  is  one  of  the  more  successful  both  in 
the  products  and  programs  it  has  produced  and  in  its  ability  to  weather 
political  and  economic  buffetings  and  because  it  was  accessible  to  us. 
Studying  this  particular  R&D  performer  allowed  at  least  a  cursory  look 
at  the  fascinating  process  of  institution-building,  and  provided  insight 
into  the  factors  contributing  to^,  this  agent's  success. 
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The  raison  d^etre,  as  for  all  the  case  studies  presented  in  this  vol- 
ume, is  to  test  the  power  and  utility  of  the  analytic  framework  when  ap- 
plied to  a  concrete  instance  of  knowledge  production  and  utilization  (KPU) 
in  education.     In  this  case,  our  focus  of  analysis  is  an  agent,   i.e.,  fWL, 
and  our  analysis  is  complex  and  conf igurational.     More  specifically,  two 
questions  guide  this  inquiry:     What  policies  and  policy  shifts  at  the  fed- 
eral level  have  had  what  impacts  on  FWL  policies,  activities,  and  agents? 
To  what  extent  and  with  what  consequences  are  policy  shifts  at  these  two 
levels  (federal  and  regional)  symbiotic?    The  second  query  is  primarily 
descriptive;  we  wish  to  describe  the  extent  to  which  both  the  federal  gov- 
ernment and  the  Laboratory  may  initiate  policy  changes  to  which  the  other 
level  responds. 

Data  collection  proceeded  along  several  lines.    First,  a  review  of 
the  relevant  literature  provided  hypotheses  that  guided  inquiry.      Most  of 
the  primary  source  materials  were  obtained  from  FWL.     Interviews  with  key 
agents  at  the  Laboratory,  especially  the  Director  and  the  Associate  Di- 
rector in  charge  of  administration,  were  particularly  helpful.     The  FWL 
files  contained  various  policies  and  procedures,   correspondence  with  USOE 
and  NIE,  minutes  of  board  meetings,,  various  papers  'and  memos,  and  the  like. 
However,  FWL  was  reorganizing,  and  because  desks,   filing  cabinets,  and 
personnel  were  being  moved,   it  was  not  always  possible  to  secure  relevant 
documents  (particularly  the  early  correspondence  with  USOE).     The  conse- 
quence is  an  overreliance  on  interviews  relative  to  the  corroboration  that 
documentation  provides.     Finally,  the  interaction  between  FWL  and  the  fed- 
eral government  is  basically  viewed  from  the  perspective  of  FWL,  which  is 
understandable  in  that  the  Laboratory  is  the  focus  of  analysis.  Neverthe- 
less, the  result  is  a  bias  in  favor  of  FWL  (in  terms  both  of  accuracy  of 
information  and  of  value  judgments). 

A  selected  bibliography  is  appended  to  this  case  study. 
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Rather  than  include  substantive  details  about  all  of  FWL' s  programs 
and  products,  we  focus  here  on  one  product,  the  Minicourse,  as  illustra- 
tive of  other  Laboratory  outputs.     Case  Study  V,  which  follows,  focuses 
on  Minicourse  development  in  detail,   so  these  two  topics  may  be  read  in 
tandem.     Finally,  Case  Study  VI  presents  another  example  of  curriculum 
development  as  a  comparison  with  the  Minicourse  case.     The  reader  may 
wish  to  keep  in  mind  the  focus  across  these  three  topics. 
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II    CONCEPTUAL  OVERVIEW 


We  framed  our  analysis  of  FWL  in  two  ways.     First,   review  of  a  por- 
tion of  the  relevant  literature  yielded  substantive  hypotheses  that  guided 
our  inquiry.     These  ideas  represent  current  thinking  about  regional  labor- 
atories and  derive  not  from  the  analytic  framework  but  from  the  observa- 
tions and  reflections  of  various  analysts.     Second,  we  introduced  some 
distinction  that  help  define  and  specify  the  application  of  the  analytic 
framework  to  the  questions  g^erating  this  inquiry.     Our  strategy,  then, 
was  to  take  account  of  current  thinking  on, the  laboratories  while  provid- 
ing a  perspective  determined  by  the  analytic  framework. 

Review  of  recent  literature  on  the  educational  R&D  community  revealed 
a  number  of  leading  ideas  with  respect  to  the  regional  laboratories,  A 
series  of  related  observations  emerged  as  guiding  hypotheses: 

•  From  the  passage  of  ESEA,  a  basic  concern  of  federal  agencies 
has  been  to  define  the  purpose  and  role  of  the  regional  labor- 
atory.    Its  functions,  particularly  in  relation  to  other  in- 
stitutions within  the  field  of  education,  have  never  been 
clearly  determined.     Moreover,   its  primary  constituency  has 
been  open* to  question. 

•  A  problem  facing  many  laboratories  is  the  difficulty  of 
maintaining  a  staff  of  quality  researchers  and  a  ''critical 
mass"  of  effort  focused  on  a  project.     The  latter  problem 
is  tied  to  the  former,  but  also  entails  shifting  policy  at 
the  federal  level,  upon  which  funding  depends. 

•  In  the  decade  of  their  existence,   the  laboratories  have  un- 
dergone abrupt  changes  in  direction  and  shifts  in  the  ''locus 
of  control."    The  most  significant  shift,  with  far-reaching 
consequences  for  laboratory  operation,  was  the  switch  from 
institutional  support  to  the  so-called  "program  purchase" 
policy. 

•  The  program  purchase  policy  has  led  to  the  increasing  poli- 
ticization  of  the  laboratories,  to  important  shifts  in 
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resource  allocation  within  the  laboratories,  and  to  a  search 
for  diverse  funding  sources--now  a  major  responsibility  for 
key  laboratory  personnel. 

As  stated,  our  analysis  focuses  on  the  impact  of  federal  policy  shift: 
on  FWL,  and  on  the  reciprocal  process  of  policy  change  between  these  two 
levels  of  policymaking.     We  require,   for  this  analysis,  some  means  of 
identifying  policies  that  define  control  over  significant  aspects  of  FWL 
operations.     We  propose  four  "realms  of  discretion,"  each  of  which  iden- 
tifies a  major  decision-making  domain  within  which  policies  act  as  one 
source  of  regulation.     These  categories  are  not  mutually  exclusive  but 
are  a  means  for  partitioning  the  decision  space  of  the  Laboratory  so  as 
to  distinguish  various  policy  shifts  according  to  the  aspect  of  laboratory 
operation  affected.     The  four  realms  of  discretion  in  our  analysis  are  as 
follows: 

•  Fiscal- -Regulating  the  flow  of  funds  between  educational 
knowledge  production  and  utilization(EKPU)  agents  and  the 
a^llocation  of  funds  for  EKPU  activities.     Policies  in  this 
realm  include  budget  statements,   contracts  and  grants,  pay 
scales,  and  the  like. 

•  Personnel — Regulating  personnel  primarily  with  respect  to 
status,   conditions,  and  benefits  of  employment.  Specifi- 
cally included  are  policies  governing  recruitment  and  hiring, 
compensation  and  benefits,   advancement,  employee  relations, 
termination  of  employment,  and  the  like. 

•  Procedural- -Regulating  the  conduct  of  agents  as  they  pursue 
the  EKPU  activities  of  management,  research,  development, 
linkage,   and  utilization.     In  this  domain  are  all  policies 
that  directly  govern  the  activities  of  agents  as  they  carry 
out  their  work.     Examples  Include  quality  control  and, review 
procedures,  development  sequences,  and  directives  that  es-  r 
tabllsh  steps  to  follow  in  carrying  out  a  particular  activity. 

•  •    Substantive — Regulating  the  initiation,  development,  an4  7 
dispensation  of  EKPU  products  and  programs.    Emphasis  falls 
not  on  the  activities  of  agents  but  on  the  development  of. 
products  and  programs.    Examples  Include  directives  specify- 
ing the  projects  to  bie  carried  out,  recommendatlonis,  and  re- 
sults of  reviews  on  proposals  for  projects. 
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In  practice,  a  policy  may  include  provisions  that  fall  onto  one  or 
all  of  these  categories.     For  example,  the  procedural- substantive  distinc- 
tion is  not  entirely  clear,  but  roughly  corresponds  to  the  difference  be- 
tween the  way  an  activity  is  to  be  carried  out,  and  a  specification  of 
that  activity  and  its  result.     With  these  hypotheses  and  these  distinctions 
in  mind,  we  may  proceed  to  the  analysis  of  FWL. 
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This  analysis  considers  the  history  of  FWL  in  three  stages.  From 
1965  through  part  of  1966  was  the  formative  period,  during  which  early 
plans  for  a  regional  laboratory  culminated  in  the.  award  of  funds  to  es- 
tablish FWL  on  a  regularly  operating  basis.     From  1966  to  1972,  FWL 
flourished.     These  were  the  institution- building  years;  Laboratory  manage- 
ment inaugurated  programs,  elaborated  an  organization,  established  oper- 
ating procedures,   and  expanded  the  scope  of  activity.     Guaranteed  financial 
support  that  was  increasing  yearly  provided  the  context  within  which  this 
development  took  place.     Since  1972,  FWL  has  undergone  a  series  of  major 
changes,   touched  off  by  transfer  from  institutional  support  to  program 
purchase  and  by  transfer  of  Laboratory  and  center  monitoring  from  USOE 
to  NIE.     Over  the  past  three  years,  major  changes  have  occurred  in  staff, 
organization,  programs,   goals,  and  management  practices.     Although  there 
are  lines  of  continuity  from  the  Laboratory's  inception  to  the  present, 
we  have  been  impressed  with  the  sharpness  of  the  break  in  1972.     It  ap- 
pears that  FWL  is  in  a  new  era  and  is  no  longer  functioning  as  it  did  in 
its  early  years, 

1965-66;     Origins  of  Far  West  Laboratory 

FWL  was  established  in  1965  under  Title  IV  of  ESEA^*  (an  amendment 
to  the  Cooperative  Research  Act  of  1954).     The  negotiations  setting  up 
the  Laboratory  were  notable  for  the  relative  lack  of  federal  regulation. 


Policies  mentioned  in  the  text  are  numbered  and  keyed  to  the  taxonomy 
in  Annex  A,  which  presents  pertinent  information  on  each  formal  policy 
mentioned. 
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A  single  four-page  document  entitled  ^'Guidelines  for  a  National  Program 
of  Educational  Laboratories*'^  was  the  sole  policy  governing  the  initial 
plan  for  a  regional  laboratory,  and  provided  only  the  most  general  guide- 
lines.    Mindful  that  a  group'-of  educators  in  Southern  California  had  been 
quick  to  submit  a  prospectus  (for  what  was  to  become  the  Southwest  Regional 
Educational  Laboratory),   several  groups  in  Northern  California  began  plan- 
ning for  a  laboratory  in  the  San  Francisco  area.     Eventually  these  educa- 
tors submitted  a  prospectus^  for  a  laboratory  to  serve  Northern  California 
and  most  of  Nevada  (later  Utah  was  to  join).     To  establish  themselves  as 
a  legal  entity,  the  participating  institutions  in  California  and  Nevada 
formed  a  Joint  Powers  Agreement^  that  set  up  a  Board  of  Directors  as  the 
principal  policymaking  body.     This  document  continues  to  be  a  foundation 
policy  statement  for  FWL,  providing  authority  for  numerous  procedural 
policies. 

The  USOE  accepted  the  prospectus  and  provided  an  initial  planning 
grant^  to  allow  development  of  a  comprehensive  plan  for  an  educational 
laboratory.  Working  quickly  under  the  leadership  of  Dr.  Robert  Gagne, 
Acting  Director,  a  small  staff  prepared  a  plan  for  FWL  that  was  submitted 
as  a  progress  report^  to  USOE  in  March  1966.  Following  the  guidelines 
sent  out  by  USOE,  the  interim  staff  based  their  program  recommendations 
on  a  series  of  need  assessments'''  conducted  in  the  region  to  be  served  by 

8 

the  laboratory.     In  this  work  the  staff  was  assisted  by  an  Executive  Panel 
of  leading  educators  in  the  area  who  served  as  consultants  in  the  deliber- 
ations of  programs  and  projects  to  sponsor.     This  group  continued  to  play 
a  critical  role  in  project  selection  and  review  until  1974,  when  it  was 
disbanded.     Upon  acceptance  of  the  progress  report,  FWL  was  officially 
established. 


ERLC 
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1966-72:     Establishment  and  Growth  of  Far  West  Laboratory 


Over  the  next  six  years,  FWL  established  an  excellent  reputation  in 
educational  product  development,   growing  rapidly  from  29  employees  in  1966 
to  247  by  1970,  with  USOE  support  increasing  from  $458,000  in  1966  to 
$2,570,000  in  1972.     The  four  realms  of  discretion  organize  an  account  of 
these  years,  and  Table  IV-1  provided  a  graphic  portrayal  of  policy  impacts. 

Procedural  Policies 

Figure  IV-1  displays  the  initial  organization  of  FWL.     As  stipulated 
by  the  Joint  Powers  Agreement,  the  Board  of  Directors  was  the  chief  policy- 
setting  agent  and  the  ultimate  seat  of  authority.     In  addition  to  estab- 
lishing policy  by  resolution,   the  board  reviewed  all  major  decisions  at 
the  laboratory  regarding  budget,  program  development,  product  release, 
staff  hiring,   and  the  like.     Of  the  two  other  agents  in  upper  management, 
the  Executive  Panel  was  significant  in  affecting  operational  decisions, 
while  the  Advisory  Commission  provided  long-range  trend  spotting  and  goal 
setting.     Until  its  phaseout  in  1974,   the  Executive  Panel^selected  and^ 
reviewed  all  Laboratory  products  and  programs.  J- 

The  Laboratory  Director  was  the  Chief  source  of  policy  initiative  at 
FWL,  with  broad  discretionary  powers  over  policies  affecting  personnel, 
operating  procedures,   financial  arrangements,  programs,  and  the  like. 
Within  each  program  division,  however,   the  division  head  had  authority 
to  develop  that  area's  programs.     In  the  Teacher  Education  Program,  for 
instance,  Walter  Borg  was  responsible  for  creating  and  implementing  the 
developmental  sequence  used  to  produce  the  Minicoiirses.     The  FWL  Manual 
of  Procedures  included  policies  regulating  the  actions  of  program  heads, 
but  none  that  specified  how  they  were  to  carry  out  their  work.  Further 
elaboration  of  FWL  structure  vould  require  a  detailed  account  of  Labora- 
tory  programs  and  projects  as  these  developed  and  changed  through  time. 
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Table  IV- 1 

POLICY  IMPACTS  ON  THE  FOUR  REALMS  OF  DISCRETION 


Procedural 


Substantive 


Federal 


ESEA  Title  IV 
Planning  Grant 


ESEA  Title  IV 

Guidelines  for--  

Educational  Laboratories 


Civil  Rights  Act,  Title  VII 
Executive  Order  11246 


FWL 

Management 


Prospectus 

Joint' I'owers  Agreement 


Needs  Assessment 
Executive  Panel  Review: 
recommendations  for  programs 


Joint  Powers  Agreement 


PI:* 

Minicourses 


FY  1966 


Federal 


USOE  funding  delay^ 
USOE  Basic  Contract 


USOE  request  to  focus 
programs 


Office  of  Contracts 
Compliance,  Employee 
Guidelines 


FWL 

Management 


PI: 

Mlnlcouraes 


Progress  report 


Progress  repprt 
Rules  for  conduct 


Executive  Panel  recommenda- 
tions for  priority  programs 


Proposed  programa 


use 

fui 

[E  Ba 
;din| 

sic  Contract 
Guidelines 

Bo 
Dl 

ird  c 
ecto 
3poae 

f  Directorj.' \  leviews 
r's  quarterly^revlew 
d  laboratory  budget 

Executive  Panel  review 
of  Mlnlcourae  topica 
Director  review 
Board  review 

Initial 

program  plan 

Develop  aequence  for 
Minicourses 

Program  director  review  of 
Mlnlcourse  topica 

FWL 

Management 


Minlcoursea 


Principal  Investigator. 
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Table  IV- I  (Continued 


PY  l';68 


Procedural 


Subscantive 


OEO  grants,  and  the  liku 

I 

USOE  rating  of  FWL 

I 

USOE  conscrucclon  grant 


Proposals  ifor . funding 
construction  proposal 


USOE  amendments  to  ^copyright 
law 


Rtquesc  for  change  In 
copyright  law 


USOE  emphasis  on  product 
dtiveloptnenc 


Request  for  copyright 
protecdon 


FY  1969 


Manual  of  Procedural 


Accounting 
Budge cs 
Contracts 


Manual  of  Procedures 

Program  Manual 

Management  Manual 
Proposal  review  • 
Development  review 
Transfer  to  ucilizacion 
Request  copyright 


Manual  of  Procedures 


Program  Manual 


EEC  Guidelines 


Manual  of  Procedures 
Perionnel  Manual 


FY  1970 


Federal 


USOE  amendments  to 
copyright  law 


FWL 

Management 


Request  for  change  In 
copyright  law 


PI:'' 

Mini courses 


Requeat  for  copyright 
protection 


Principal  inveitigator, 
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Table  IV-1  (Continued) 


Federal 


FWL 

>tanagenient 


PI: 

Mlnicourses 


Substantive 


Federal 


FWL 

Management 


Minlcournes 


NIE  rating  of  FWL  an 
financially  independent 

Fee  guidelines 

Federal  procurement  regula- 
tion! ' 


Fee  proposal  contracts 


Talk  Force  Maater  Panel-*  

-recommeivdationsA  no  addenda 

Special  panel  recotranenda- 
tioni  and  classifications 
\ 

-Director ' I  recommendations 
on  utilization 


Laboratory  appeals  on  class 


Revised  program  plans- 
addenda  to  plana 


EEO  Guidelines 


Affirmative  Action  Plan 


Contracts  with  NIE,  OEO, 
and  others 


Contracts  with  NIE,  OEO, 
and'others 


EEO  guideline  changes- 


FWL 

Management 


Proposals 


Fixed-term  employee 
contracts 


Propoaals 

Emphaais  on  service 


One-month  notice  of  re- 
lease 


Affirmative  Action  Plan- 


Pt: 

MinlcoUrses 


Employee  salary^  benefits, 
and  the  like 


Staff  termination 


Principal  investigator. 
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Table  IV- 1  (Concluded) 


FY  ViU 


Procedural 


Subs fan ctve 


FWL 

Management 


PI: 

Minicourses 


Contracts,  with  NIE,  OEO, 
and  others 


Proposals 


Management  directives  and 
operating  procedures 
(initial  version) 


Contracts  with  NIE,  OEO, 
and  others 


Proposals 


Federal 


FWL 

Management 


PI:'' 

Minicourses 


r  I    Lit  fj 

SIE  reduction  In  funding^ 

Rede£ii 
employi 

lit  Ion  of  FWL-"*  

lent  area 

Reorganization  o£  management 
-structure:    Board  resolution 
on  257.  time  to  ALD  Council 

^Reducing  scope  of  work  in 
Mlnlcourse  research  program 

Affirm 
Appeal 

itlve  Action  Plan 
on  H.R.  C.  ruling— 

•-Principal  Investigators 
submit  contracts  to 
administration  for  scrutiny 

(1)  "Federal"  refars  to  several  agencies:    Congress,  USOE,  NIE,  OEO,  and  private  funding  agencies. 

(2)  "FWL  Management"  refers  to  several  agents  within  the  Laboratory;     Director,  Executive  Panel,  Board  of  Directors,  and 
ad  hoc  review  panels. 

(3)  Each  policy  is  listed  in  the  year  that  It  first  appeared;  many  of  these  policies  continue  in  effect  (e.g.,  the  process 
for  negotiating  the  Laboratory  budget  each  year). 


Principal  investigator. 
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Board  of  Directors  . 


Executive  Panel 


Advisory  Commission 


Executive  Secretary 


Laborator 

/  Director 

Deputy 

Director 

Personnel  Assistant 


Technical  Advisory 
Committees 


J  !  r- 

Research  and  Development  Programs 


Sustaining  Programs 


Full 
Education 


Curriculum 


Instructional 
Mtthods 


Education 
of  Teachers 


Communication 
and 
Information 
 1  


Administrative 
Services 


Ad  Hoc  Task  Force  Teams  to  Conduct  Research 


Production 
Services 


Business 
Services 


Personnel 
Services 


FIGURE  IV-1    ORGANIZATION  OF  FAR  WEST  LABORATORY:  1965 

Our  analysis  does  not  include  this  level  of  detail,  however,  and  so  we 
will  use  the  Teacher  Education  Program  as  illustrative  of  policy  impacts 
on  the  researcher. 

Between  1966  and  1972^  Laboratory  policy  grew  apace  with  the  expan- 
sion and  increasing  complexity  of  Laboratory  operations.     There  were  es- 
sentially two  levels  of  policy.     At  the  highest  level,  FWL  policies 
included'  the  Joint  Powers  Agreement,  the  Rules  for  the  Conduct  of  Business, 
and  the  collected  resolutions  and  recommendations  of  the  Board  of  Directors.^^ 
The  interpretation  and  translation  of  these  general  statements,  however,  re- 
quired more  detailed  operating  procedures.    Over  several  years,  this  sec- 
ond level  of  policy  was  elaborated,  frequently  revised,,  and  ultimately 
codified  in  the  three-volume  Manual  of  Procedures, most  sections  of  which 
date  from  1969. 
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Whereas  the  superordinate  authority  for  policies  in  the  Manual  of  Pro 
cedures  may  be  traced  to  either  the  Joint  Powers  Agreement,  the  Rules  for 
Conduct,   or  the  Board  of  Directors,  the  Manual  contains  the  detailed  ex- 
plication of  policy  with  which  Laboratory  personnel  must  comply.     We  will 
deal  with  the  relevant  sections  of  the  Manual  under  each  of  the  realms  of 
discretion.     Of  principal  interest  is  the  Program  Manual  section,  which 
provides  the  principal  policies  regulating  the  conduct  of  researchers;  we 
shall  present  these  policies  in  some  detail. 

The  conduct  of  R&D  at  FWL  was  regulated  by  a  process  of  review  and 
revision  at  several  key  points: 

1  2 

•  Submitting  a  proposal  for  a  product  or  program, 

•  Developing  the  product  to  the  point  where  it  could  be  re- 
leased.-'*^ 

•  Transferring  the  product  from  a  developmental  program  to  a 
general  dissemination  program. •'•^ 

•  Requesting  developmental  or  limited  cppyirights, '''^ 

At  various  points  in  each  of  these  R&D  stages,  the  Manual  called  for  elab- 
orate review  by  the  program  director,  an  ad  hoc  review  team  of  Laboratory 
personnel,  the  Laboratory  Director,   the  Executive  Panel,  and  the  Board  of 
Directors.    Figures  IV-2  through  IV-8  detail  each-  of  these  four  review 
sequences,  accompanied  by  explanatory  notes.     Examination  of  these  flow- 
charts suggests  several  observations: 

•  The  Laboratory  Director  was  a  crucial  agent  in  each  of  these 
sequences,  reviewing  products  at  the  proposal,  developmental, 
and  dissemination  stages.     Lines  of  authority  converged  on 
him  at  numerous  points,  and  while  program  directors  had  au- 
tononry  in  planning  and  carrying  out  R&D,  the  results  of  their  . 
efforts  were  repeatedly  subject  to  scrutiny.     Most  signifi- 
cantly, no  FWL  product  was  released  to  the  public  without 

the  Laboratory  Director's  approval, 

•  The  Executive  Panel  also  had  a  critical  role  in  the  review 
and  development  process,  although  in  some  cases  at  the  Labor- 
atory. Director  '  s  discretion  (see  Figure  IV-5),     Its  primaiy 
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Recycit 


Start 


Develop 
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(Initiator) 


Otvelop 
First  Draft 

(initiator) 


First  Draft 


Memo  to  Initiator 
and  Laboratory 
Director 


Proposal 
Alert 


Prtpart  Proposal 
Alert  to  Program 
Cabinet  (Program 
Director) 


Stiect  Rivltw 
Ttam 

(Laboratory 
Director) 


Riviiw  Proposal 
(Rtview  Tiam) 


Revised  Proposal 


Revist 

Proposal 

(Initiator) 


Second  Draft 

Develop  Second 
Draft 

(Initiator) 

Place  on  AgtrxJa  for 
Board  of  Directors 
(Laboratory 
Director) 


Memo  to 
Initiator  arKl 
Program  Director 
(Laboratory 
Director). 


f^te:  Before  FWL  committed  resources  to  a  development  project,  a  thorough  review  of  the  proposed 
project  was  conducted  by  the  program  director,  Director,  review  team,  Executiv]rJ[HuieL  and 
Board  of  Directors.  "'^ 


FIGURE  IV-2   PROPOSAL  REVIEW 
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tion  (Levt)  i),  pap«rs  for  rilitst  and  distribution  to  outsidt  audltncts  (Lavai  M).  official  Labo* 
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FIGURE  IV-3    STEPS  FOR  DEVELOPING  A  LABORATORY  PRODUCT:  LEVELS  lA  AND  IB 
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FIGURE  IV-4    STEPS  FOR  DEVELOPING  A  LABORATORY  PRODUCT:  LEVEL  11 
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FIGURE  IV.5   STEPS  FOR  DEVELOPING  A  LABORATORY  PRODUCT:  LEVEL  III 
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FIGURE  IV-7    STEPS  FOR  TRANSFERRING  A  LABORATORY  PRODUCT  FROM  DEVELOPMENTAL  PROGRAM 
TO  GENERAL  DISSEMINATION  PROGRAM 
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^function  was  to  advise  in  the  selection  of  programs  and  prod- 
ucts for  the  Laboratory  to  develop. 

•  The  copyright  sequence  was  a  chief  instance  of  the  Laboratory's 
influence  on  the  Office  of  Education.     It  was  at  the  behest 

of  FWL  and  some  of  the  other  laboratories  that  USOE  provided 
developmental  and  limited  copyright  coverage  for  laboratory 
products  through  amendments  in  1968  and  1970  to  copyright 
policy. 

The  procedural  constraints  on  the  research  are  evident  in  Figures  IV- 2 
through  IV-8.    A  policy  analysis  of  any  single  Laboratory  product  would 
reveal  the  policy  decisions  taken  at  each  of  the  various  decision  points 
shown  in  these  figures.     For  example^  a  number  of  the  Minicourses  were 
killed  at  the  proposal  stage^   and  others  on  the  basis  of  poor  field-test 
data  (see  Case  Study  V  for  further  details).     Laboratory-wide  quality  con- 
trol procedures^   then^  were  a  significant  regulator -of"  R6cD  activity  at 
FWL. 

Fiscal  Policies 

From  1966  to  1972^  FWL  received  its  funding  through  a  basic  contract"^' 
negotiated  yearly  with  USOE.     The  Budgeting  section  of  the  Manual  of  Pro- 
cedures specified  the  following  budget-making  sequence: 

•  Each  program  director  developed  a  program  plan      that  pro- 
vided a  detailed  breakdown  of  proposed  activities^  with 
budget  estimates  and  ratio;.ale. 

•  The  business  manager  translated  these  plans  into  the  for- 
mat      required  by  the  "Guidelines  for  the  Preparation  of 
the  Contractor's  Request  for  Continual  Funding." 

•  These  program  plans  were  assembled  into  a  Laboratory  bud- 
get''"^ and  sent  to  the  Board  of  Directors  for  approval. 

•  This  budget  became  the  basis  for  negotiations  with  USOE, 

•  Upon  successful  completion  of  negotiations^   the  revised 
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budget      was  presented  to  the  Board  of  Directors  for  final 
approval, 

•  The  Laboratory  Director  conducted  quarterly  reviews  of  the 
budget. .  * 
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Policies  associated  with  this  budget  cycle  were  the  primary  fiscal  con- 
straints on  the  Laboratory.     Each  year  the  basic  program  plans  developed 
by  the  program  directors  established  the  broad  outlines  of  work  for  the 
succeeding  year.     USOE  exercised  fiscal  authority  during  the  negotiation 
process,  but,  as  noted,  funding  for  the  Laboratory  rose  steadily  during 
these  years,  and  there  were  no  major  USOE  interventions  to  redirect  al- 
locations or  to  reduce  significantly  the  amounts  requested.     FWL  funding 
came  primarily  from  the  basic  contract  with  USOE,  but  there  were  other 
contracts  as  well  during  these  years.     For  instance,   the  Early  Childhood 
Program  received  funds  from  the  Office  of  Economic  Opportunity  (OEO),  the 
Carnegie  Corporation,      and  others.     These  various  contracts,  of  course, 
also  acted  as  significant  fiscal  policies  regulating  the  work  specified 
therein. 

Substantive  Policies 

Laboratory  policies  best  characterized  as  substantive  were  the  pro- 
gram and  project  reviews  and  recommendations  of  the  Executive  Panel,  the 
Board  of  Directors,   the  Laboratory  Director,  and  the  program  directors. 
As  indicated  earlier,  the  Executive  Panel  played  a  major  role  in  selecting 
the  initial  programs  for  the  Laboratory,  basing  its  decisions  in  part  on 
need  assessments  of  the  region  served.    Under  the  quality  control  proce- 
dures detailed  in  Figures  IV-2  through  IV-8,  all  further  proposals  for 
projects  and  all  works-in-progress  were  subject  to  close  scrutiny.  The 
results  of  these  reviews  were  the  primary  policy  decisions  governing  FWL 
operation.     It  proved  beyond  the  scope  of  this, analysis  to  provide  a  de- 
tailed account  of  these  policy  decisions  for  each  of  the  Laboratory's  pro- 
grams, but  we  may  illustrate  the  operation  and  consequences  of  these 
reviews  with  the  Minicourse  program.     Of  24  Minicourses,  9  were  terminated 
by  FWL  (5  in  the  proposal  stage  and  4  at  various  stages  of  testing).  This: 
indicates  that  the  review  process  was  a -significant  policy  regijlai tor 
Laboratory  projects  and  products. 


A  second  source  of  substantive  policy  was  USOE^,  v?hich  conducted  a 
number  of  reviev?s  of  FWL  betv?een  1966  and  1972.     In  addition,  program  moni 
tors  reported  regularly  on  specific  Laboratory  programs.     The  recommenda- 
tions of  these  review?  committees  and  monitors  v?ere  potentially  important  a 
substantive  policy  regulators,  but  our  research  indicates  that  they  had 
a  relatively  negligible  influence.     Sometimes,  hov?ever,   the  recommenda- 
tions were  helpful,   and  occasionally  the  reviewers  were  used  almost  as 
consultants  by  the  Laboratory.     In  one  instance,   a  media  specialist  re- 
viewing the  development  of  Minicourses  provided  such  invaluable  advice 
on  the  technical  equipment  for  the  production  of  the  Minicourse  kit  that 
he  was  called  in  as  a  consultant.     When  reviewers  were  competent,  and 
knowledgeable  about  the  program  under  scrutiny,   their    criticisms  were 
constructive  and  were  heeded  by  Laboratory  personnel;  when  reviewers  were 
not  competent  to  judge  Laboratory  activities,  their  reports  made  little 
difference.     Apparently,   evaluations  by  these  review  committees  did  not 
formally  influence  USOE  policy,   and  the  impact,   if  any,  on  FWL  operations 
was  informal  and-  direct. 

During  these  years,  however,  policy  shifts  at  the  federal  level  in- 
fluenced the  operation  of  the  laboratories.     FWL  was  one  of  the  Labora- 
tories least  influenced  and,  whether  by  good  planning  or  circumstance, 
managed  to  operate  effectively.     The  chief  policy  shifts  and  their  impact 
on  the  Laboratory  included  the  following: 

•  In  1966,  USOE  imposed  a  three-month  moratorium^^  on  funding 
while"^  Dr.  Francis  Chase  conducted  a  review  of  Laboratory 
activities.     As  a  result,  USOE  directed  the  laboratories  to 
focus  their  program  efforts  on  making  significant  and  im- 
mediate progress.     FWL  responded  with  an. intensive  two-month 
planning  session  that  resulted  in  the  proposal  of  six  pro- 
grams.^*    The  Executive  Panel  chose  teacher  education  and 
communication  as  top  priorities. 

•  In  1968,  Dr.  Norman  Boyan,  newly  appointed  Associate  Com- 
missioner of  Research  at  USOE,   signaled  a  change  in  emphasis 
for  the  laboratories.     To  justify  budget  increases  he  had 
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requested  and  to  meet  criticisms  of  the  laboratories  from 
within  government,  he  stressed  product  development  as  the 
top  priority,^^     Because  FWL  was  already  substantially  en- 
gaged in  such  work,   this  shift  had  little  impact  on  its 
programs,  but  the  impact  of  this  policy  change  on  many  other 
laboratories  is  said  to  have  been  large, 

•  With  the  advent  of  the  Nixon  administration  in  1969,  crit- 
icism of  laboratories  and  centers  increased  and  culminated 
in  a  policy  to  decide  which  laboratories  were  effective 
enough  to  be  maintained,  and  which  should  be  closed.  Site 
reviews  were  used  for  judgments  on  laboratory  performance,  > 
and  in  1969  five  laboratories  were  closed,   followed  by  four 
more  in  1971.     Again,  FWL  remained  unaffected  because  they 
were  judged  too  strong  even  for  a  review. 

In  spite  of  substantial  federal  policy" shifts  relative  to  laboratories 
during  these  years,   stimulated  by  changes  in  administration  and  by  grow- 
ing criticism  of  the  rising  expenditures  for  the  laboratories,     FWL  was 
not  significantly  influenced.     The  reasons  are  not  easy  to  determine.  In- 
cluded among  the  possibilities  are  that: 

•  FWL  had  a  particularly  good  track  record, 

•  Astute  management  practices  at  FWL  were  a  major  factor, 

•  Key  agents  at  the  Laboratory  exhibited  political  savvy  in 
gaining  influence  with  pivotal  agents  at  the  federal  level, 

•  By  simple  good  luck,  FWL  management  decisions  accorded  well 
with  the  imperatives  of  federal  policymaking, 

A  study  emphasizing  formal  policy  regulators  does  not  provide  the  oppor- 
tunity to  weigh  these  possibilities,  but  after  completing  this  account  of 
Laboratory  operations  we  may  speculate  briefly  on  this  question. 

Personnel  Policies 

The  Personnel  Manual,^®  chief  source  of  policy  regulating  FWL  staff, 
rested  on  the  relevant  sections  of  the  Joint  Powers  Agireement,.  the  Rules 
for  Conduct,  Board  of  Directors'  resolutions,  and  federal  employment  poli- 
cies.    Its  chief  sections  covered  recruitment  and  hiring,   compensation  and 
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benefits,  staff  advancement,  professional  activities,  termination  of  em- 
ployment, and  employee  relations.     A  detailed  listing  of  these  procedures 
is  not  necessary,  but  personnel  policies  were  significant  because  they 
affected  the  recruitment  and  maintenance  of  a  top-flight  staff,  one  of  the 
crucial  responsibilities  for  an  R6dD  manager.     According  to  the  Director, 
FWL  was  fortunate  in  attracting  and  holding  quality  researchers,  which  he 
attributed  to  the  appeal  of  the  San  Francisco  Bay  Area.     In  addition,  how- 
ever, he  cited  a  generous  pay  scale  and  fringe  benefits,  and  favorable  op- 
portunities for  advancement  as  reasons  for  FWL's  success  in  maintaining  a 
good  staff.     How  these  policies  affected  the  quality  of  R&D  at  FWL  is  dif- 
.ficult  to  determine.    The  principal  investigator  on  a  research  project  is 
always  a  key  element  in  the  quality  of  the  work,  so  that  personnel  policies 
and  work  conditions  attracting  good  researchers  presumably  contribute  to  the 
quality  of  research,  but  this  contribution  is  indirect  and  difficult  to 
trace. 

A  number  of  federal  policies  and  agencies  regulated  personnel  pro- 
cedures.    Title  VI  of  the  1964  Civil  Rights  Act^'''  was  (and  continues  to  be) 
a  principal  guarantoi:  of  equal  employment  opportunity  in  federal  agencies, 

as  was  Executive  Order  11246.        The  Equal  Employment  Opportunity  Commisi- 
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sion  (EEOC)  publishes  guidelines      for  the  1964  Civil  Rights  Act  covering 
recruiting,  hiring,   firing,  transfer,  and  training.     The  Office  of  Federal 
Contracts  Compliance  within  the  Department ' of  Labor  also  required  com- 
pliance with  the  Civil  Rights  Act  and  the  Executive  Order  by  means  of 
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Stipulations      in  all  federal  contracts.    This  office  now  issues  the  af- 
firmative action  guidelines  as  well,  although  oversight  of  affirmative 
action  plains  has  been  the  responsibility  of  several  agencies  (including 
HEW,  the  Agency  for  International  Development,  and  the  General  Services 
Administration).     Careful  scrutiny  of  FWL's  affirmative  action  plans  and 
issuance  of  detailed  guidelines  for  their  preparation  did  not  begin  until 
the  1970s,  and  so  will  be  dealt  with  in  a  later  section.    According  to  the 
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Director,  ?WL  had  (and  continues  to  have)  the  finest  minority  staff  in  the 
country.,  and  has  had  no  difficulty  in  developing  or  in  complying  with  af- 
firmative action  plans. 

The  preceding  account  of  major  policies  at  FWL  between  1966  and  1972 
is  revealing.     These  were  years  during  which  the  Laboratory  established 
itself  as  a  basically  successful  entity.     There  were  instances  of  failure-- 
the  multicultural  program  in  particular  was  a  frustrating  and  ultimately 
frustrated  effort — but  by  and  large  the  Laboratory  prospered.     It  expanded 
its  staff  and  facilities,   received  increasing  amounts  of  federal  support 
(of  the  35  laboratories  and  centers  established,  only  Southwest  Regional 
Educational  Laboratory  and  Research  for  Better  Schools  have  received  more 
funds  than  FWL),  and  produced . several  products  judged  exemplary  by  inde- 
dependent  reviews.     Our  analysis  suggested  that  the  attraction  and 
maintenance  of  a  highly  regarded  staff  of  experienced  researchers  was  an 
important  factor  in  FWL's  success.     With  a  stringent  process  of  testing 
and  development  to  validate  Laboratory  materials  and  a  solid  staff  to  plan 
and  carry  out  this  work,   FWL  impressed  USOE  administrators  as  a  quality 
R6cD  performer.     In  summary,  then,   sound  research  management  practice s«- 
quality  control  procedures  in  particular--and  a  strong  staff  were  critical 
to  the  Lab's  success.     With  evidence  of  thorough  development  practices  and 
a  number  of  successful  products  at  hand,  federal-level  administrators  were 
willing  to  let  FWL  continue  its  work  without  much  interference. 

During  these  years  the  locus  of  control  over  Laboratory  activities 
was  centered  at  the  Laboratory  itself.     As  discussed.  Laboratory,  personnel 
had  to  comply  with  federal  policies,  particularly  in  the  fiscal  and  sub- 
stantive realms.     The  potential  for  intervention  in  Laboratory  operations 
existed  in  the  form  of  contract  negotiations,   site  reviews,  and  employment 
guidelines,  but  these  options  for  control  were  not  often  exercised.  Other 
than  the  1966  moratorium  on  funding  and  the  adjuration  to  develop  specific 
program  plans,  we  discovered  no  major  intervention  or  policy  shift  at  the 
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federal  level  that  significantly  influenced  Laboratory  operations  at  FWL. 
Two  points  should  be  emphasized,  however.     First,  FWL  was  somewhat  unique 
in  that  it  was  so  little  affected  by  policy  shifts  at  the  federal  level. 
Second,  while  there  were  federal  policies  (i.e.,  contract  guidelines)  that 
required  compliance,   it  was  the  major  shifts  in  federal  policy  tov^ard  the 
laboratories  that  did  not  impact  FWL. 

Focusing  on  the  lines  of  initiation  and  response  during  these  years 
reveals  a  pattern  of  relations  among  the  three  levels  of  program  directors 
(principal  investigators),  FWL  management,   and  federal  agents.  Fiscal 
control  clearly  resided  with  USOE,  while  control  over  procedural  and  sub- 
stantive matters  rested  primarily  with  FWL  management.     According  to  aca- 
demic standards,  individual  researchers  were  relatively  constrained  in 
their  freedom  of  inquiry.     However,  the  option  to  initiate  a  project  still 
existed  at  the  researcher  leveX- -perhaps  the  most  important  freedom  of 
all.    Thereafter,  of  course,  any  project  ran  a  gamut  of  reviews,  perhaps 
discouraging  to  the  individual  investigator  but  necessary  to  the  Labora- 
tory.    In  addition  to  federal- level  policy  shifts,  modest  policy  changes 
occurred  at  the  FWL  management  level.     Recognition  of  the  ne6d  for  copy- 
right coverage  to  attract  commercial  distributors  prompted  FWL  and  other 
laboratories  to  seek  the  necessary'  amendments  to  copyright  law  from 
USOE.     Changes  in  the  law  were  made  in  1968  and  1970  to  include  develop- 
mental  and  limited  copyright  coverage      for  laboratory  products.     In  gen- 
eral, there  was  a  balance  of  authority  among  these  three  levels,  with  FWL 
management  exerting  the  strongest  influence  during  these  years. 

1972-75:     Transition  to  and  Impact  of  the  NIE 

Several  months  before  the  creation  of  NIE  in  1972,  USOE  Initiated  a 
new  funding  policy  patterned  on  the  competitive  procurement  model  used  by 
other  federal  agencies  like  the  Department  of  Defense.    Under  the  new 
policy,  all  R&D  would  be  procured  through  a  competitive  bidding  process 
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based  on  the  stipulation  of  work  in  a  Request  for  Proposal  (RFP).  The 
Transition  Task  Force  ushering  in  NIE  inherited  this  new  policy,  adopting 
"program  purchase,"  as  it  came  to  be  called,   for  the  NIE,     This  new  policy 
together  with  the  transfer  of  laboratory  responsibility  from  USOE  to  NIE  re 
suited  in  significant  changes  in  almost  every  aspect  of  laboratory  opera- 
tion.    In  the  following  pages  we  document  the  repercussions  of  policy 
shifts  at  one  level  of  authority  on  subordinate  levels  of  action.  Again, 
we  use  the  four  realms  of  discretion  to  organize  the  account. 

Fiscal  Policy 

The  chief  shift  concerned  fiscal  policy;  most  significantly,  the 
fiscal  basis  for  all  Laboratory  programs  changed  with  the  switch  to  pro- 
gram purchase.     There  was  no  longer  a  basic  contract  to  support  existing 
programs.     Based  on  a  review  of  the  Laboratory's  programs  by  Transition 
Task  Force  panels,  certain  programs  received  continuation  contracts  (e.g,, 
Minicourse  testing),  and  other  programs  were  terminated  (e.g.,  the 
Information-Utilization  Program,  and  in  1974  the  Educational  Management 
Program),     Facing  a  sudden  drop  in  funding,  the  Laboratory  began  an  in- 
tensive effort  in  1973  to  search  for  funding  opportunities.     Over  six 
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months,  extending  to  June  1974,  FWL  developed  and  submitted  31  proposals 
to  NIE  and  other  agencies  and  foundations.    This  effort  was  successful, 
but  did  not  meet  the  real  problem,   i.e.,  control  over  Laboratory  direc- 
tion and  future  planning.     Finally  and  most  recently,   shifts  in  fiscal 
policy  due  to  the  shrinking  appropriations  voted  NIE  had  an  impact  on  FWL, 
NIE  appropriations  decreased  from  1972  to  1975,   instead  of  rising  as  ex- 
pected.    The  fiscal  year  1975  appropriation  was  reduced  from  i^n  initial 
budget  request  of  $130  million  to  $70  million,   $19  million  below  the 
agency's  projected  continuations,  and  $5,7  million  below  the  previous 
year's  appropriation.     NIE  has  attempted  to  honor  its  good- fath  agree- 
ments with  the  laboratories  by  fulfilling  the  three-year  contracts  set 
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as  a  result  of  the  task  force  review  in  1972,     To  live  within  the  reduced 
appropriations,  it  has  been  necessary  to  cut  existing  continuations  by  157o, 
This  has  resulted  in  reductions  in  the  scope  of  work  covered  by  NIE  con- 
tracts, including  the  Minicourse  research  project. 

Other  shifts  in  fiscal  policy  were  related  to  the  switch  to  program 
purchase.     Under  USOE,  FWL  was  considered  a  financially  dependent  con- 
tractor who  negotiated  a  nonfee-bearing  contract.     In  1968,  USOE  rated 
the  laboratories  then  in  operation,  and  those  who  received  a  "mature" 
rating  were  asked  to  submit  a  proposal  for  a  construction  grant,     FWL  was 
one  of  the  laboratories  and  centers  to  respond.     Based  on  this  rating  and 
subsequent  ratings  of  "maturity,"  FWL  was  categorized  as  financially  in- 
dependent by  NIE.^^     This  policy  shift  had  consequences  to  which  FWL  is 
still  responding.     While  a  nonfee-bearing  contractor  cannot  legally  be 
held  accountable  for  cost  overruns,   satisfactory  completion  of  work,  and 
the  like,  a  fee-bearing  contract  is  subject  to  such  restrictions.  Pri- 
marily, this  means  the  laboratory  operations  are  subject  to  stricter  ac- 
counting measures.     Greater  definitude  of  iEinancial  data,  contractual 
compliance,  and  administrative  resources  in  general  is  required.  Con- 
sequently, FWL  is  developing  a  data  processing  system  and  a  management 
information  system  to  meet  these  more  stringent  demands  for  accountability. 

The  program  purchase  policy  further  entails  the  switch  to  fee-bearing 
contracts.    The  Fee  Guidelines^*''  are  now  in  effect  as  key  policy  regulators, 
and  the  Laboratory  must  engage  in  the  lengthy  process  of  fee  negotiation 
for  each  contract.     Likewise,  in  the  absence  of  a  basic  contract  to  sup- 
port research  and  researchers,  FWL  must  establish  a  capital  reserve,  i.e., 
build  up  equity  beyond  the  fees  arid  overhead  provisions  subject  to  negotia- 
tion.    This  reserve  is  particularly  important  in  supporting  "down  time'* 
for  researchers  whom  the  lab  wishes  to  retain  (although  the  capital  re- 
serve funds  have  not  yet  been  put  to  this  use). 
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Program  purchase  policy  has  also  influenced  the  negotiation  of  over- 
head rates.     Under  USOE  and  with  a  basic  contract,   such  negotiation  was 
a  standard  procedure.    Today  when  FWL  as  an  independent  contractor  pro- 
poses its  annual  provisional  overhead  rate,  it  is  subject  to  much  greater 

scrutiny  and  lengthy  negotiation.     As  well,   federal  procurement  regula- 
rs 

tions      preclude  use  of  contract  funds  for  developing  proposals.  Since 
such  expenditures  constitute  all-owable  overhead  expense,  FWL's  overhead 
has  been  increased  by  about  $250,000  per  annum.     Moreover,   the  increased 
time  and  effort  devoted  to  these  negotiations  has  necessitated  some  orga- 
nizational changes,  which  will  be  discussed  below. 

Procedural  Policies 

FWL  has  undergone  extensive  reorganization  to  cope  with  the  new  pro- 
curement system.     Figures  IV-9  and  IV-10  show  the  most  recent  (1974) 
reorganization  of  Laboratory  structure.     Under  the  new  funding  arrangements, 
the  Executive  Panel  was  superfluous  and  was  discontinued.     Whereas  the 
principal  investigators  (Pis)  had  worked  independently,  they  now  report  di- 

39  " 

rectly  to  the  Director,      who  coordinates  and  oversees  the  work.     The  Di- 
rector's Council,   composed  of  the  eight  associate  directors,  is  an  important 
policy-setting  and  advisory  body  that  meets  regularly  with  the  Director  to 
consider  matters  of  Laboratory-wide  import.     Each  of  the  associate  directors 
must  devote  25%  of  his/her  time  to  business  of  the  Council the  remaining 
757o  is  allotted  to  project  work  and  other  line  functions.     The  purpose 
of  this  new  structure  is  to  provide  flexibility  in  work  on  a  series  of  con- 
tracts while  maintaining  control  and  coordination  over  the  variety  of  work 
in  progress.     Staff  and  line  functions  are  no  longer  separate,  as  there  must 
be  greater  coordination  among  the  functions  of  planning,   financing,  and 
carrying  out  the  work. 

The  Planning  and  Proposals  Office  has  the  crucial  function  of  monitor- 
ing RFPs  and  determining  the  proposals  to  which  the  Laboratory  should 

IV- 34 


154 


Laboratory  Director 


DIRECTOR'S  COUNCIL 


Research 


(25%) 


Development 


(25%) 


Service 


(25%) 


Administration 


(25%) 


Planning/Proposals 


(25%) 


Teaching 


(25%) 


Organization 


(25%) 


Materials 


(25%) 


"1 


Interface 

with 
Projects 


Executive  Secretary 


Note:  All  members  of  the  Director's  Council  are  Associate  Laboratory  Directors. 

FIGURE  IV-9    MATRIX-STRUCTUREOF  DIRECTOR'S  COUNCIL 
OF  THE  FAR  WEST  REGIONAL  LABORATORY 


respond.     This  office  must  devise  a  strategy  allowing  FWL  to  define  and 
pursue  its  own  goals  and  respond  successfully  to  enough  RFPs  to  guarantee 
stable  and  sufficient  funding.     Currently,   the  Planning  and  Proposals  Of- 
fice is  drawing  up  long-range  plans  that  may  form  the  "basis  for  FWL' s 
future  responses  to  RFPs. 

A  final  Change  has  been  subsumption  of  all  administrative  responsi- 
bilities under  one  office.     In  the  past,  each  division  had  some  adminis- 
trative tasks  such  as  negotiations  for  overhead,  budgeting,  contacts  with 
contracts  officers,  and  the  like.     Today,  however,  with  the  increased 
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stringency  of  accounting  procedures^  one  office  assumes  responsibility 
for  these  matters.     Consequently,  principal  investigators  are  accountable 
to  administration  for  matters  like  cost  overruns,  which  must  be  more  care- 
fully  monitored. 

With  changes  in  every  aspect  of  Laboratory  operation,  it  was  neces- 
sary to  revise  the  Manual  of  Procedures.     To  date,  the  structure  of 
internal  policy  has  been  set.     The  new  manual,  "Management  Directives  and 
Operating  Procedures, "'^^  establishes  three  levels  of  policy:  Laboratory 
Policy  as  defined  by  the  Joint  Powers  Agreement,  Rules  for  the  Conduct  of 
Business,  and  Board  Resolutions  and  Motions;  Management  Directives  that 
translate  general  policy  into  more  detailed  directives,   and  augment  and 
clarify  policy  for  specific  situations;  and  Operating  Procedures  that  de- 
fine the  procedural  steps,  to  implement  policy  and  directives.     FWL  is 
still  in  transition  with  respect  to  procedural  policies;  the  old  manual 
is  obsolete  and  the  new  manual  has  not  yet  been  compiled.  Consequently, 
it  is  difficult  to  provide  a  more  detailed  account  of  Laboratory  proce- 
dures. 

Substantive  Policies 

The  shift  to  NIE  had  both  short-term  direct,  and  long-term  indirect 
effects.     The  former  resulted  from*  the  work  of  the  task  force  that  managed 
the  transition  of  laboratory  and  center  programs  from  USOE  to  NIE.     The  / 
latter  resulted  from  FWL's  response  to  the  exigencies  of  the  program  pur- 
chase policy.     We  will  discuss  these  effects  below,  beginning  with  those 
that  were  short-term  and  direct. 

The  task  of  transferring  work  under  way  at  the  laboratories  and  cen- 
ters to  NIE  fell  to  National  Center  for  Educational  Research  and  Develop- 
ment (NCERD).     In  the  spring  of  1972,  a  review  of  each  laboratory' s  programs 
was  launched  using  a  series  of  panels,  each  panel  being  responsible  for  one 
content  area,    A  master  panel  reviewed  all  reports  submitted  and  made  the 
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final  decision  on  the  dispensation  of  existing  programs. The  recommenda- 
tions of  the  specialist  panels  were  in  effect  crucial  policy  decisions  af- 
fecting all  FWL  programs  then  in  progress. 

Two  aspects  of  these  panel  recommendations  especially  affected  Labor- 
atory programs.     First^  each  specialist  panel  made  specific  recommendations 
on  the  nature  of  work  to  be  carried  out  in  that  program.     For  example, 
the  recommendations  on  the  Minicourses  called  for  the  following: 

•  Begin  systematic  evaluation  of  effects  of  Minicourse  train- 
ing on  student  outcomes. 

•  Enlarge  the  R&D  component  to  include  activities  of  summative, 
comparative  evaluation  of  product  effectiveness  using  a  var- 
iety of  pupil  product  measures. 

•  Complete  all  products  under  development. 

•  Hold  work  on  courses  for  which  the  main  field  test  has  not 
begun. 

These  directives  substantially  altered  the  nature  of  this  program  and  pro- 
duced a  number  of  changes  at  the  Laboratory.     Other  recommendations  by 
specialist  panels  for  all  the  major  programs  necessitated-considerable 
reorganization,  reallocation  of  resources,  reappraisal  of  objectives,  and 
reassignment  of  staff. 

Second,   the  panels  classified  each  program  into  one  of  six  categories, 
which  determined  the  funding  level  for  that  program: 

•  Funding  for  program  in  question  will  be  continued. 

•  Substantial  program  modifications  are  being  considered. 

•  Substantial  cuts  in  funding  from  the  level  requested  are 
being  considered  (greater  than  15%). 

•  A  funding  recommendation  is  being  considered  close  to  the 
level  requested. 

•  The  program  is  classified  as  a  "new  start,"  and  further  con- 
sideration will  be  postponed. 

•  Other. 
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The  classifications  each  program  received  determined  its  future  status  and 

4  5 

prospects.        The  major  FWL  programs  fared  well  and  received  continuation 
contracts  although  in  most  cases  changes  were  requested  in  the  scope  and 
nature  of  the  work.     Three  programs,  however,  were  classified  "new  starts" — 
Early  Childhood,  Renewing  Home-School  Linkage,  and  Inf ormation-Utilization-- 
which  meant  a  delay  and  possibly  an  end  to  their  funding.     FWL  responded 

4  6 

by  appealing  the  classification,  and  "won"  two  of  the  three  cases.  The 
Information-Utilization  program  ended,  however,  as  funding  was  ultimately 
discontinued. 

The  final  action  governing  FWL  utilization-dissemination  efforts 
proved  particularly  galling.     The  Information-Utilization  Program  at  the 
Laboratory  had  been  categorized  as  a  new  start  even  though  FWL  had  engaged 
in  utilization  activities  for  a  number  of  years.     (In  1970,  utilization 
activities  for  all  programs  were  gathered  in  one  division;  the  task  force 
considered  this  the  starting  date  for  a  utilization  program,  and  categor- 
ized it  a  new  start.)     To  provide  funds  for  utilization,  the  task  force 
director  suggested  that  the  program  be  disbanded  and  provision  for  utili- 

4  8 

zation  activities  be  appended  to  plans  for  the  other  Laboratory  programs. 
FWL  complied,  only  to  learn  some  weeks  later  that  the  master  panel,  pressed 

49 

for  time,  had  refused  to  consider  any  addenda  to  the  program  plans.  Con- 
sequently, FWL  lost  most  of  its  funding  for  utilizationrdissemination  ef- 
forts, and  their  work  in  this  area  has  been  considerably  curtailed  since 
1972. 

Evidence  exists  that  FWL  had  some  impact  on  policy  decisions  made  by 
the  Transition  Task  Force  of  NCERD.     The  Laboratory  was  able  to  win  two  of 
three  appeals  on  program  classifications,  and  the  task  force  solicited  re- 
sponse to  the  specialist  panels*  program  recommendations  through  meetings 
and  in  writing.     On  the  other  hand,   the  head  of  Teacher  Education  vehemently 
protested  the  decision  to  halt  Minicourse  development  and  embark  on  a  new 
research  effort,  but  these  objections  did  not  affect  the  final  decision.  It 
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appears^   then^   that  while  FWL  had  some  effect  on  task  force  decisions  and 
was  given  some  opportunity  to  participate^  most  decisions  were  made  uni- 
laterally beyond  any  influence  from  FWL. 

Beyond  this  impact  on  specific  Laboratory  programs^   there  were  the 
effects  of  program  purchase  on  Laboratory  planning  in  general,  First^ 
program  planning  fell  into  disarray  (between  1972  and  1974)  as  FWL  faced 
the  dilemma  of  attempting  to  respond  to  RFPs  over  which  they  had  little 
control  while  maintaining  some  initiative  in  preserving  long-standing 
interests^  programs^  and  goals.     Under  the  new  organization^  however^  the 
Planning  and  Proposals  Office  has  assumed  the  planning  function.  Second^ 

a  new  program  emphasis  has  been  developed-- supplying  direct  services  to 

s  0 

LEAs.     A  program  division  created      to  accomplish  this  purpose  offers 
services  such  as  providing  materials^  consultation^  workships^  and  train- 
ing sessions;  assistance  in  planning^  developing^  and  evaluating  programs; 
and  aid  in  producing  media.     To  say  that  this  new  direction  results  solely 
from  the  shift  to  program  purchase  policy  would  be  an  exaggeration^  but 
there  is  a  strong  connection.     By  emphasizing  direct  service^  FWL  hopes 
to  build  a  constituency  at  the  local  level  to  support  its  existence.  Like- 
wise^ this  service  emphasis  is  likely  to  appeal  to  Congressmen  who  demand 
immediate^  tangible  results  from  their  investment  of  the  tax  dollar.  Hence^ 
one  might  conclude  that  the  shift  in  federal  funding  policy  has  affected 
the  priorities  among  mission  goals  at  FWL. 

Personnel  Policies 

Changed  work  conditions  at  FWL  have  had  a  particularly  severe  impact 
on  personnel.     First^  with  the  loss  of  institutional  support^  the  Labora- 
tory was  forced  to  release  many  employees  at  various  levels  of  authority  - 
(see  the  effects  on  Minicourse  staff^  as  reported  in  Case  Study  V).  The 
issue  is  not  simply  that  cutbacks  in  funds  have,  required  reduction  of 
staff.     Rather^  the  necessity  to  respond  regularly  to  RFPs  requires  new 
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skills  and  combinations  of  skills.     Frequently  projects  are  multidiscipli- 
nary;  also,   the  disciplinary  background  necessary  for  one  project  may  be 
irrelevant  for  the  next,  making  it  difficult  to  recruit  permanent  staff. 
The  new  funding  situation  places  a  premium  on  flexibility,  while  FWL  has 
in  past  operated  as  a  traditional  employer  establishing  long-term  staff 
commitments  through  benefits,  retirement  plans,  and  the  like.     The  Labora- 
tory has  responded  to  this  new  situation  with  two  policy  changes.  First, 
staff  are  now  given  only  one  month's  notice, instead  of  up  to  four  months' 
notice.     Second,  FWL  now  uses  fixed-term  contracts  for  its  personnel,  with 
all  aspects  negotiable. Thus,   the  Laboratory  can  hire  short-term  staff 
to  work  only  for  the  duration  of  a  particular  contract.     The  number  of 
permanent  employees  has  decreased  since  1972,  and  the  number  of  temporary 
staff  has  increased. 

Since  1972,  policy  shifts  at  the  federal  level  unrelated  to  the  pro- 
gram purchase  policy  have  also  affected  FWL  employment  practices.  As  men- 
tioned, responsibility  of  affirmative  action  plans  has  resided  in  several 
agencies.  In  addition,  the  guidelines  for  these  plans  have  changed.  Ini- 
tially guidelines  were  fairly  general  in  requiring  "fair"  employment  prac- 
tices.^^ More  recently,  these  guidelines  have  stressed  quota  requirements 
for  minority  hiring,  based  on  specific  numerical  goals  derived  from  De- 

54 

partment  of  Labor  statistics. 

The  most  recent  review  of  FWL's  Affirmative  Action  plan  produced 
another  change:     The  Human  Rights  Commission,  which  now  monitors  Af:  rma- 
tive  Action  plans,  rules  that  the  employment  area  for  FWL  was  not  the  Bay 

55  , 

Area,  as  previously  assumed,  but  the  City  of  San  Francisco.        Since  the 
percentage  of  minorities  differs  in  these  two  areas--the  concentration  is 
greater  in  San  Francisco — this  ruling  requires  revision  of  the  Laboratory ' s 
Affirmative  Action  plan,     FWL  has  appealed  this  ruling  with  the  argument 
that  the  Laboratory  has  always  drawn  its  employees  from  the  entire  Bay 
Area;^®     to  date  there  has  been  no  reply  to  this  appeal.    Over  the  years, 
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however^  FWL  has  not  had  difficulty  in  attracting  well-qualified  minority 
staff^  and  compliance  with  federal  policy  in  this  area  has  raised  no  prob- 
lems . 

Summary 

Since  1965^  there  has  been  no  consistent  federal  policy  on  the  lab- 
oratories and  centers.    Apparently^  the  initial  plan  was  to  establish  a 
group  of  regional  laboratories  to  serve  regional  needs  and  interests.  As 
Washington  became  disenchanted  with  increasing  expenditures  for  education^ 
a  press  developed  for  greater  responsiveness  to  -national  needs^  i.e,^ 
product  development  for  national  distribution  rather  than  direct  service 
to  regional  groups.     At  present^  the  laboratories  and  centers  lack  any 
special  relationship  with  a  federal  agency  and  operate  as  individual  en- 
tities whose  paramount  concern  is  survival.     Calculations  based  on  this 
need  to  survive  play  an  increasingly  important  role  in  defining  the  mis- 
sion and  the  type  of  activity  that  laboratories  pursue. 

Maintaining  a  "critical  mass"  of  researchers  to  systematically  at- 
tack a  problem  has  been^particularly  acute  since  1972,     Research  staff  is 
a  vital  ingredient  in  an  R&D  performer's  success^  but  the  uncertainty  of 
funding  and  the  necessity  to  remain  flexible  in  terms  of  staff  skills  and 
training  may  well  undercut  the  Laboratory's  ability  to  attract  and  hold 
top  researchers.    Moreover^  FWL  must  now  devote  a  greater  proportion  of 
its  resources--time^  money^   and  personnel--to  locating  suitable  funding 
sources  and  to  writing  proposals,  which  may  mean  a  decreased  ability  to 
develop  and  maintain  a  critical  mass  of  effort  over  time  around  a  selected 
topic  of  concern,     Asecond  point  is  that  many  educational  problems  are 
tractable  only  with  steady,  prolonged  work.    A  mode  of  research  procure- 
ment emphasizing  many  short-term  contracts  does  not  allow  a  research  team 
the  time  or  resources  to  mount  a  sustained  research  effort.    The  slow. 
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incremental  nature  of  R^D  runs  counter  to  the  need  for  immediate  solu- 
tions to  pressing  problems;  the  result  frequently  is  a  rush  to  judgment, 
i.e.,   the  bandwagon  effect.     At  any  rate,  sustaining  inquiry  on  a  par- 
ticular issue  will  probably  continue  to  be  a  problem  for  the  laboratories, 
planning  notwithstanding. 

Little  comment  is  necessary  about  the  effects  of  policy  shifts  at 
the  federal  level.     As  discussed,   the  program  purchase  policy  has  had  num- 
erous effects  on  FWL,  including  the  Laboratory's  increasing  politicization 
as  it  seeks  to  establish  support,  influence  in  higher  councils,  and  a 
firmer  financial  base.     Specifically,  the  new  emphasis  on  educational  ser- 
vices reflects  a  perception  of  the  need  to  build  a  political  constituency 
at  the  grass-roots  level.     The  recent  successful  lobbying  efforts  of  Coun- 
cil for  Educational  Development  and  Research  (CEDaR)  to  earmark  part  of 
NIE's  fiscal  1976  appropriation  for  the  laboratories  and  centers  is  another 
indication  of  political  activism  at  the  federal  level.     Then,   too,  there 
is  the  "dealing^*  entailed  in  the  RFP  bidding  process:     "Pre- arrangement 
seems  to  be  the  rule  rather  than  the  exception,   in  consideration  of  po- 
tential contractors  and  grantees.     However  an  idea  origixiates,   it  is  ap- 
parently common  practice  ...  to  discuss  a  project  extensively  with  a 
favored  award  recipient,  and  to  work  out  some  sort  of  plan  for  proceeding. 
When  this  is  done^   the  formalities  are  then  instituted  as  an  afterthought" 
(Green,   1971).      In  this  situation,  FWL  may  not  need  good  researchers  as 
much  as  a  few  intelligence  men  privy  to  the  inside  information  on  RFPs. 
This  reality  of  the  procurement  process  strongly  favors  contractors  with 
political  savvy  and  connections. 

Finally,  we  may  summarize  the  shifts  in  locus  of  control.  It  is  too 
early  to  assess  the  influence  of  the  principal  investigator  under  the  new 
organization.     The  Director's  Council  may  become  a  critical  policy-setting 

References  are  appended  to  this  case  study. 
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body  at  the  Laboratory^   in  part  replacing  the  Executive  Panel;  this  shift 
suggests  increased  responsibilities  for  principal  investigators.     The  Di- 
rector retains  his  preeminent  authority  and  to  him  falls  the  responsibility 
of  reviewing  all  proposals^  prototype  materials^  field-test  data^   and  the 
like.     In  addition^  he  oversees  the  day-to-day  work  of  principal  investi- 
gators even  more  closely  than  before^  and  so  retains  signficant  control 
over  all  activities.     While  there  has  been  some  shift  in  control  within 
the  Laboratory^   the  principal  shift  has  occurred  between  FWL  management 
and  the  federal  level.     The  program  purchase  policy  allows  federal  agencies 
to  specify  in  detail  the  substance  of  the  research  to  be  carried  out^ . the 
amount  .and  allocation  of  funds  for  that  research,   and  to  an  extent  the  pro- 
cedures and  methods  of  research.     While  there  is  room  for  negotiation  over 
an  RFP,  the  initiation- response  ratio  has  shifted  heavily  in  favor  of  the 
federal  level.     Neither  FWL  management  nor  principal  investigators  have 
as  much  discretion  in  the  conduct  of  R&D  as  they  had  before  1972.     On  the 
basis  of  this  policy  analysis,  we  cannot  judge  one  strategy  versus  another; 
such  judgment  must  ultimately  rest  on  the  consequences  of  each  strategy, 
not  on  policy  implications. 
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IV    REFLECTIONS  ON  METHODOLOGY  AND  THE 
ANALYTICAL  FRAMEWORK 


Difficulties  in  UsinR  the  Analytical  Framework 

Although  the  analytical  framework  helped  considerably  in  the  initial 
structuring  of  the  inquiry^   it  was  not  too  helpful  in  the  actual  collec- 
tion of  data.     This  is  significant  because  a  major  difficulty  in  pursuing 
this  topic  proved  to  be  data  collection.     The  framework  can  certainly  sug- 
gest what  information  to  obtain,  but  cannot  assist  the  process  of  getting 
it.     Only  the  diligence  of  the  analyst  ensures  that  all  relevant  data  have 
been  collected.     This  aspect  of  policy  analysis  is  no  different  from  in- 
vestigative reporting,  in  which  corroboration  of  facts  by  multiple  sources 
is  the  principal  guarantee  of  accuracy.     In  this  case,   time  constraints 
coupled  with  confusion  at  the  Laboratory  due  to  reorganization  and  reloca- 
tion resulted  in  a  lack  of  thorough  documentation.     This  is  of  interest 
as  more  than  a  mea  culpa,  however,  as  it  points  to  the  basic  problem  of 
underestimating  the  amount  of  time  and  effort  necessary  to  uncover  the 
interactions  of  policies,  agents,  and  activities  over  a  significant  pe- 
riod.    Key  agents  will  probably  be  vague  and  unreliable  when  delving  ten 
years  into  the  past,  and  key  policies  may  not  be  formally  codified  but 
may  exist  only  in  correspondence,  inter-  or  intra-agency  memos,  minutes 
of  various  committees,  and  the  like.     Locating  and  piecing  together  these 
policies  is  an  extremely  demanding  task.     What  occurs,   then,  is  a  process 
of  simplification  to  accommodate  the  amount  of  information  one  is  actually 
able  to  obtain.  ^ 

One  condition  determining  the  form  and  content  of  a  case  study  is 
the  kind  and  amount  of  information  that  the  analyst  is  able  to  collect. 
That  no  c^se  study  is  any  better  than  the  data  on  which  it  is  based  may. 
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be  a  trivial  observation,  but  in  another  sense  it  points  to  a  certain 
danger  in  using  the  framework;  i.e.,  the  terms  "significant"  or  "relevant" 
or  "major"--when  applied  to  policies,  activities,  and  the  like — become 
merely  euphemisms  for  that  which  is  available.     The  significance  of  a 
policy  cannot  be  an  a  priori  claim  in  an  analysis,  but  is  in  fact  what 
must  be  demonstrated  by  the  analysis. 

A  primary  criterion  by  which  to  judge  the  significance  of  a  policy  is 
the  purpose  of  the  analysis,  i.e.,  the  particular  question  generating  in- 
quiry.    In  a  case  study  of  any  size,  there  will  initially  be  myriad  poli- 
cies requiring  attention.     The  decision  as  to  which  policies  should  be 
called  out  in  detail,  which  touched  on,  and  which  ignored  altogether  must 
be  made  with  reference  to  the. topic  of  analysis.     For  this  reason,  select- 
ing the  purpose  of  analysis  and  identifying  the  focus  and  field  of  analy- 
sis  (Steps  One  and  Two  of  the  mapping  paradigm)  are  extremely  important. 
When  in  doubt  about  the  relevance  of  a  policy  or  activity,   first  recourse 
is  to  the  purpose  and  to  the  focus  of  analysis  for  clarification.  In 
practice,  of  course,  the  result  of  frequently  consulting  this  purpose  may 
be  its  reformulation,  which  is  in  itself  a  valuable  outcome.  Experience 
with  this  case  study  has  strongly  supported  the  advice  provided  earlier 
in  this  report:     state  the  purpose  of  inquiry  as  concretely  as  possible, 
return  to  it  often  for  revision,  and  use  this  statement  as  an  aid  in  the 
process  of  selectively  attending  the  data. 

A  Potential  Source  of  Error  in  Using  the  Framework 

A  distinction  has  been  made  between  "logic- in-use"  and  "reconstructed 
logic"   (Kaplan,  1964).     The  former  refers  to  the  actual  cognitive  pro- 
cesses--which  are  more  or  less  logical--that  scientists  employ  in  the  con- 
duct of  inquiry.     The  latter  refers  to  explicit  formulations  of  these 
processes,  principally  as  normative  discourse,  which  philosophers  of 
science  and  others  create.     A  reconstructed  logic  is  not  a  description, 
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but  rather  an  idealization  of  scientific  practice.     This  is  a  useful  dis- 
tinction to  keep  in  mind  relative  to  use  of  the  analytic  framework.     When  • 
one  reflects  on  the  process  of  carrying .out  a  policy  analysis  with  the 
aid  of  a  conceptual  tool  such  as  the  analytic  framework,   it  is  easy  to 
substitute  a  reconstructed  logic  for  the  logic-in-use.     The  result  is 
more  elegant  and  rational  than  the  actual  case.     From  our  experience  with 
this  case  study,  we  see  danger  in  the  following  sequence  (a  potential 
logic-in-use):     first,  underestimating  the  time  entailed  in  data  collec- 
tion; next,   of  necessity  gathering  only  those  facts  that  are  most  acces- 
sible;  and,   finally,  appending  the  honorific  "significant"  to  the  data, 
when  that  is  precisely  what  is  to  be  established,  and  when  what  is  meant 
is  "available." 

V. 

Ideas  for  Further  Exploration 

Although  the  key  terms  in  the  taxonomy  and  the  steps  of  the  mapping 
paradigm  were  useful  in  the  inquiry,   in  this  topic  it  would  have  been 
misleading  to  structure  the  entire  analysis  around  categories  to  be  found 
in  the  framework. 

Table  IV-1  presented  four  categories--f iscal,  procedural,  substantive, 
and  personnel — that  we  found  useful  for  this  topic.     We  draw  attention  to 
the  usefulness  of  these  categories  for  two  reasons.     First,   findings  using 
these  categories  can  be  compared  with  findings  that  result  from  the  other 
case  studies  in  this  volume.     (If  each  study  turns  up  a  unique  set  of  cate- 
gories that  are  clearly  more  useful  as  descriptive  rubrics  than  those  in 
the  taxonomy,   then  it  would  seem  that  a  general  taxonomy  is  not  of  par- 
ticular use  in  describing  the  governance  of  KPU. )    Second,  we  believe  that 
this  particular  set  of  four  categories  might  prove  useful  for  organizing 
empirical  studies  connecting  measures  of  R&D  quality  and  productivity  with 
variations  in  the  numbers  and  kinds  of  policies  constraining  researchers. 
Table  IV-1  can  clearly  reveal  periods  of  policy  expansion  that  could  be 
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linked  to  appropriate  output  measures  of  R&D  activity.     Arguments  over 
the  locus  of  control  for  research  could  certainly  benefit  from  empirical 
results  demonstrating  the  efficacy  of  various  patterns  of  control. 

While  conducting  this  case  study,   an  alternative  method  of  conceptual- 
izing and  presenting  the  topic  occurred  to  us.     Although  this  idea  came 
too  late  to  incorporate  in  the  study,  we  feel  it  is  potentially  valuable 
and  warrants  a  brief  exposition  here. 

The  case  study  as  written  alludes  to  the  locus  of  control  over  re- 
search activities,  as  defined  either  by  formal  policy  or  by  an  agent's 
area  of  discretion  in  setting,   interpreting,   or  implementing  policy.  More 
specifically,   shift  in  locus  of  control  was. a  dominant  motif,  yet  it  was 
never  demonstrated  with  concrete  detail.     Reflection  on  this  shortcoming 
suggested  the  following  approach. 

•  Conceive  the  conduct  of  research  at  FWL  in  terms  of  de- 
cisions that  must  be  made.     To  organize  thinking  about 
these  decisions,   the  four  realms  of  discretion  are  use- 
ful.    We  do  not  have  to  introduce  a  new  concept,  i.e., 
"decision,"  into  our  system  because  each  decision  state- 
ment specifies  an  activity. 

•  Develop  a  taxonomy  of  these  decisions  beginning  with  the 
four  discretionary  realms--personnel,  procedure,  sub- 
stance, and  fiscal--and  developing  further  headings  and 
subheadings  as  necessary. 

•  Design  a  table  with  three  columns:  decision/activity; 
policy  (the  policies  regulating  that  decision);  and  agents 
(those  having  discretionary  authority  over  tfiat  decision). 

•  To  indicate  shifts  in  regulation,  consider  several  possible 
devices.     Decision  maps  for  more  than  one  time  period  may 
be  drawn,  or  color  coding  may  be  used  to  indicate  policies 
and  agents  at  various  time  points. 

With  this  scheme,  which  enters  the' system  by  means  of  decisions,  we  can 
portray  patterns  of.>regulation  efficiently  and  concisely^  and  demonstrate 
how  these  patterns  change  over  time.     Such  a  table  would  allow  quick  ap- 
praisal of  which  activities  or  decisions  are  controlled  by  which  policies 
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and  agents  at  which  levels  of  authority.     Enumerating  decisions  would  be 
the  most  difficult  aspect  of  this  scheme  with  no  guarantee  than  an  even- 
tual list  is  either  complete  or  stable,  but  we  feel  this  approach  is 
feasible.     To  demonstrate  this  approach,  we  offer  the  following  example 
relative  to  fiscal  decisions  with  the  caveat  that  more  detail  is  needed 
in  enumerating  decisions. 

1  Allocating  funds  to  FWL 

1.1  for  overhead  expenses 

1.2  for  specific  programs 

1.2.1  for  specific  activities  within  a  program  (in  this 
case,  Minicourse  development ) . 

2  Monitoring  expenditures  by  FWL. 

Table  IV-2  presents  these  decisions  for  two  time  period.     Treating  this 
set  of  decisions  from  most  to  least  specific,  we  have  observed  the  fol- 
lowing:    From  1966  to  1972,   the  program  director  for  Minicourse  develop- 
ment was  responsible  for  drawing  up  a  basic  program  plan  in  which  he 
specified  the  funds  necessary  for  ongoing  and  projected  work  on  the  Mini- 
courses.     This  plan  included  both  program  and  overhead  expenses.     At  the 
FWL  management  level,   this  plan  was  subject  to  scrutiny  by  the  Laboratory 
Director,  who  had  discretionary  authority  to  request  changes.  Discretion- 
ary authority  of  the  Laboratory  Director  and  the  Board  of  Directors  also 
influenced  the  allocation  of  funds  among  the  various  FWL  programs,  which 
was  a  key  element  in  establishing  the  overall  negotiating  budget  for  the 
Laboratory.     The  formal  policy  regulating  the  negotiating  budget  resides 
in  the  budget  section  of  the  Manual  of  Procedures  and  requires  review  of 
all  basic  program  plans  by  the  Laboratory  Director  and  approval  by  the 
Board  of  Directors.  ' 

A  second  and  equally  important  source  of  governance  was  USOE,  First, 
each  program  plan  had  to  meet  the  requirements  of  the  relevant  guidelines 
set  by  federal  procurement  regulations.     Second,  a  contracts  officer  at 
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Table  IV- 2 

A  DECISION-ORIENTED  STRUCTURING  OF  POLICIES 


Activity 

Policy 

Agent *s  Area  of  Discretion* 

(a)  lyoD-iy/z 

1 

USOE  Contracts  Officer 

for  FWL 

1.1 

Allocating  funds 

Federal  Procurement 

USOE  Contracts  Officer; 

for  overhead 

Regulations 

Laboratory  Director;  PI 

expenses 

1.2 

Allocating  funds 

Federal  Procurement 

USOE  Contracts  Officer; 

for  specific 

Regulations  Section 

Board  of  Directors; 

programs 

of  Budget  Manual 

Laboratory  Director 

1.2.1 

Allocating  funds 

Federal  Procurement 

USOE  Contracts  Officer: 

within  a  program 

Regulations  Section 

Laboratory  Director;  PI 

of  Budget  Manual 

2 

Controlling 

Section  of  Budget 

USOE  Contracts  Officer;. 

expenditures 

Manual  ^ 

Laboratory  Director;  PI 

(b)  1972-1975 

1 

IT  L  (J V XUl.Llg  l.ULiua 

for  FWL 

1.1 

Allocating  funds 

rcQcX^cii.    IT  L  L;C>U  1.  ClUC  LIL. 

USOE  Contracts  Officer 

for  overhead 

Regulations 

expenses  ^ 

1.2 

Allocating  funds 

Contracting  Agent; 

for  specific 

Director;  Director's 

programs 

Council;  Planning  and 

Proposals  Office;  PI 

1.2.1 

Allocating  funds 

Fee  Guidelines 

USOE  Contracts  Officer 

within  a  program 

2 

Controlling 

Federal  Procurement 

USOE  Contracts  Officer; 

expenditures 

Regulations 

Laboratory  Administration 

Listed  in  order  of  descending  authority. 
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USOE  exercised  discretionary  authority  in  negotiating  the  budget  with  FWL 
management.     This  agent  had  ultimate  authority  over  the  amount  of  funds 
provided  the  Laboratory,   although  Laboratory  management  could  influence 
his  decision  through  the  negotiating  process.    .Finally,  the  budget  had 
to  be  ratified  by  the  Board  of  Directors,   but  this  was  primarily  a  for- 
mality. 

In  the  second  major  decision  area-- control  over  actual  expenditures-- 
the  locus  of  control  rested  primarily  within  the  Laboratory.     Because  FWL 
negotiated  a  nonf ee-bearing  contract,   they  were  not  legally  accountable 
for  cost  overruns  or  the  like.     The  progress  of  expenditures  was  regulated 
by  three  agents:     the  contracts  officer;   the  Laboratory  Director,  who  made 
quarterly  reviews;  and  the  PI.     Between  1966  and  1972,  however,   there  were 
no  strict  cost  accountability  requirements  nor  were  there  sanctions  to  be 
applied  under  the  provisions  of  nonf ee-bearing  contracts. 

The  foremost  change  after  1972  was  that,  without  financial  support^ 
FWL  had  to  search  actively  for  funding.     The  crucial  decisions  now  con- 
cern selecting  those  RFPs  to  which  responses  should  be  made.  Stipulating 
specific  activities  and  the  funding  to  suppolrt  them  falls  within  the  au- 
thority of  the  contractor,  generally  a  federal  agency  such  as  NIE  or  USOE. 
Because  of  its  independent  status,  FWL  now  negotiates  fee-bearing  contracts, 
so  the  fee  guidelines  are  the  principal  policies  regulating  specific  pro- 
visions of  each  contract.     As  already  mentioned,  accountability  with  re- 
spect to  cost  overruns,   satisfactory  completion  of  work,  and  the  like  are 
legally  enforceable  though  the  courts,   so  Laboratory  administration  now 
monitors  the  work  and  expenditures  for  each  contract  more  closely.     As  a 
result,   the  principal  investigator  has  considerably  less  control  over  al- 
locations and  expenditures  than  forynerly.     Hence,  another  key  shift  in 
locus  of  control  has  centered  on  the  monitoring  of  expenditures,  which 
principally  resides  with  the  federal  contracting  agencies. 
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FWL  is  attempting  to  regain  a  measure  of  initiative  in  locating  re- 
sources for  programs.     The  Planning  and  Proposals  Office  must  take  recom- 
mendations on  which  RFPs  merit  response,   subject  to  review  by  the  Director 
and  the  Director's  Council,   so  that  in  one  sense  control  over  allocation 
of  funds  to  programs  rests  with  FWL  management.     However,   in  practice,  it 
is  frequently  the  principal  investigator  with  a  good  reputation  who  unites 
the  proposal  and  secures  funding,  and  the  decision  to  award  funds  lies  in 
the  hands  of  the  agency  putting  out  the  RFP.     It  appears,  in  this  case, 
that  no  clear  assignment  of  authority  can  be  made,  but  rather  that  aspects 
of  control  are  shared  at  all  three  levels. 

A  shift  has  occurred  with  respect  to  overhead  rates,  however.     As  men- 
tioned,  federal  procurement  regulations  prohibit  use  .of  contract  funds  to 
develop  proposals,  which  has  increased  the  overhead  rate,  and  this  rate  is 
now  subject  to  greater  scrutiny  by  the  contracts  officer.     The  discretionary 
authority  of  this  federal  agent  acts  as  a  more  powerful  regulator  than  in 
the  past. 

Overall,  a  significant  shift  in  locus  of  control  has^clearly 
taken  place  since  1972.     The  federal  agencies  that  put  out  RFPs  have  ulti- 
mate control  over  the  allocation  of  resources  to  FWL  and  to  programs  within 
FWL.     All  FWL  contracts  are  now  subject  to  stricter  controls  and  the  con-  . 
tracts  officer  has  increased  discretionary  authority  in  monitoring  con- 
tracts.    The  Laboratory  preserves  some  initiative  in  selecting  RFPs.  Its 
choices  being  influenced  by  a  number  of  agents  within  the  Laboratory:  the 
Director,  the  Director's  Council,   the  Planning  and  Proposals  Office,  .and 
the  principal  investigators  (many  of  whom  sit  on  the  Director's  Council). 
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V  RECOMMENDATIONS 


Although  a  number  of  recommendations  could  be  made  based  on  our  re- 
search of  this  topic,  we  make  only  one:     that  NIE  sponsor  a  study  to  de- 
scribe and  document  the  history  of  the  laboratory  and  center  program  as 
a  case  study  in  federal  KPU  management. 

The  KPU  institutions--the  regional  laboratories,   the  R&D  centers, 
and  the  policy  research  centers--created  by  the  Elementary  and  Secondary 
Education  Act  in  the  mid-1960s  are  social  inventions  that  represent  the 
largest  single  strategic  investment  in  EKPU  made  by  the  federal  govern- 
ment  to  date.     To  some  extent,   the  very  formation  of  the  National  Insti- 
tute  of  Education  stemmed  from  a  recognition  that  these  new  KPU  institutions 
could  not,  by  their  very  nature,  be  well- governed  by  an  institution  such  as 
the  U.S.  Office  of  Education. 

This  case  study  indicated  that  one  of  these  institutions-- the  Far  West 
Regional  Laboratory--f ared  relatively  well  when  confronted  with  a  variety 
of  unanticipated  policy  changes  from  the  federal  government.     On  the  other 
hand,   it  is  apparent  that  many  other  institutions  fared  far  less  well,  and 
that  the  lack  of  policy  regulators  requiring  more  stability  in  governance 
policy  from  the  federal  level  should--from  a  systems  perspective--be  of 
concern.     It  is  one  thing,  however,   to  assert  from  an  academic  perspective 
that  the  federal  government  should  somehow  be  subjected  to  the  types  of 
regulative  influences  it  would  place  on  other  institutions.     It  is  quite 
another  to  figure  out  just  what  types  of  influences  would  be  appropriate 
to  suggest.  .  ^ 

Because  the  history  of  the  laboratory/ center  experiment  is  so  in- 
credibly rich  in  potential  learnings  about  KPU  governance  (both  positive 
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and  aegative)^  and  because  more  needs  to  be  understood  about  the  impacts 
on  the  KPU  field  of  rapid  and  unanticipated  shifts  in  federal  KPU/manage- 
ment  strategy^  we  most  strongly  recommend  that  NIE  or  a  private  foundation 
sponsor  a  relatively  thorough  case  study  of  federal  involvement  with  the 
regional  laboratories^  the  R&D  centers  and  the  policy  research  centers. 
Among  the  issues/ concerns  that  such  a  case  study  might  address  are  the 
following: 

•  What  happened  to  the  institutional  support  procurement 
policy?    How  was  it  changed,   and  with  what  explicit 
rationales?    What  do  actors  who  were  behind  the  scenes 
say  about  the  ways  through  which  this  policy  was  changed? 

•  What  happened  to  the  different  roles  that  were  to  be 
played  by  the  three  types  of  institutions--the  regional 
J.aboratories,   the  university-affiliated  centers,  and  the 
policy  research  centers?    Have  they  maintained  a  differ- 
entation  of  functions,  or  has  the  competitive  pressure 
for  funds  made  them  all  claim  expertise  in  essentially 
the  same  skills? 

•  What  major  strategic  changes  in  program  management  policy 
occurred  from  the  inception  of  the  laboratory/ center  pro- 
gram until  the  most  recently  established  NIE  policy? 
What  major  impacts  on  the  laboratories  and  centers  appear 
to  have  been  caused  by  these  changes? 

•  To  what  extent  can  various  conceptual  strategies  (such  as 
those  often  referred  to  as  "R&D,"  "RDDA,"  and  "KPU")  or 
the  lack  of  any  such  strategy,  given  the  pressures  of 
bureaucratic  life  (i.e.,  "muddling  through"),  be  identi- 
fied as  having  been  followed  by  the  federal  laboratory/ 
center  program  managers? 
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TAXONOMY  OF  ALL  POLICIES 


Number 

Policy 

Substance 

Type 

Source 

Target 

1 

ESEA  Title  IV 

Enabling  legislation 
to  establish  a  re- 
gional, laboratory 

Statutory 
(enactment) 

U.S.  Congress 

FWL 

2 

Guidelines  for  a 
national  program 
of  educational 
laboratories 

Drawing  up  a  pros- 
pectus for  a  re- 
gional laboratory 

Administrative 
(guidelines) 

HEW 

Groups  to  form 
regional  lab- 
oratories 

3 

Prospectus  estab- 
lishing a  re- 
gional laboratory 

Initial  plan  for  FWL 

Nongove rnmental 
(proposal ) 

Planning  group-- 
FWL 

HEW 

4 

Joint  Powers 
Agreement 

Establishing  Board 
of  Directors,  voting 
and  meeting  proce- 
dures, officers, 
agencies,  scope  of 
powers,   and  with- 
d r awal  p  ro cedu  re  s 

Constitutional 
(articles  of 
incorporation) 

Signatories  of 
Agreement 

FWL 

5 

HEW— USOE  plan- 
ning grant 

Drawing  up  plans  for 
FWL 

Contract 
(contract) 

HEW  and  USOE 

FWL  planning 
staff 

6 

Progress  report 

Setting  goals,  orga- 
nization structure, 
and  initial  projects 
for  FWL 

Administrative 
(guidelines) 

FWL  planning 
staff 

USOE 

7 

Needs  assessments 

Setting  needs  and 
priorities  for  re- 
gion served  by  FWL 

Administrative 
(guidelines) 

FWL  management 

FWL  staff 

8 

FWL  Executive 
Panel  program 
recommendations 

Initial  projects  and 
programs  for  FWL 

Administrative 
(guidelines) 

FWL  Executive 
Panel 

FWL  management  ^ 

9 

Rules  for  the 
Conduct  of  Busi- 
ness 

Board  meetings; 
election/ removal  of 
officers;  recording 
provisions;  author- 
ity of  Director 

Administrative 
(guidelines) 

FWL  Board  of 
Directors 

FWL  management 
and  staff 

10 

Resolutions  of 
the  FWL  Board  of 
Directors 

Formal  approval  foir 
all  F\'iL  business  and 
operations 

Administrative 

discretionary 

act) 

FWL  Board  of 
Directors 

FWL  staff 

U 

Manual  of  Proce- 
du  res 

Procedures  for  man- 
agement property 
control ;  program 
proposal  and  review; 
personnel;  adminis- 
trative services; 
accounting;  budget- 
ing; contracts, 
agreements 

Administrative 
(regulations) 

FWL  management 

FWL  staff 

12 

Proposal  review: 
Section  20.01- 
.03.  Manual  of 
Procedures 

Reviewing  all  pro- 
posals for  projects 
and  programs 

Admini  s  t  ra  tive 
(regulations) 

FWL  tnanagement 

FWL  staff 
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Number 

Policy 

Substance 

Type 

Source 

Target 

Product  develop- 
ment and  release: 
Section  30.01- 
.05,  Manual  of 
Pro  cedures 

Quality  control 
checks  for  four 
classes  of  7\IL 
products 

Administrative 
(regulations) 

FWL  management 

FWL  staff 

14 

Transfer  product 
from  development 
to  utilization 
program:  Section 
^u*  \JL   •         rianu a i 
of  Procedures 

Reviewing  products 
for  release  and 
preparing  a  utili- 
zation plan 

Administrative 
(regulations) 

FWL  management 

FWL  staff 

15 

Applying  for  copy- 
right:    Part  V, 
Proposal  Manual j 
Manual  of  Proce- 
dures 

Reviewing  request 
for  copyright  cov- 
erage of  FWL  prod- 
ucts 

Administrative 
(regulations) 

FWL  management 

FWL  staff 

16 

Basic  contracts, 

tlCnC    anA  T7UT 

uoUiL  anu  r  wLi 

Covering  all  pro- 
grams and  projects, 
including  overhead 
expenses 

Contracts 
(contract  s) 

HEW  and  USOE 

FWL 

17 

Basic  program 
plans 

Details  of  R&D,  ac- 
tivities for  each- 
ma  j  or  division  of 
FWL 

Administrative 
(common  law) 

FWL  division 
heads 

FWL  staff  and 
team  leaders 

18 

Guidelines  for 
preparation  of 
contractor's  re- 
quest for  con- 
tinual funding 

Preparing  FWL  budget 

Administrative 
(guidelines) 

USOE 

FWL 

19 

FWL  negotiating 
budget 

All  programs  and 
projects,  as  well  as 
overhead 

Administrative 
(common  law) 

FWL  management 

USOE 

20 

Approved  budget, 
FWL 

All  programs,  proj- 
ects^ and  overhead 
for  each  year, 
1966-72 

Administrative 
(discretionary 
act) 

FWL  management 

T7LTT     «?  »•  o  -P  P 

21 

Quarterly  reviews 
of  FWL  budget  by 
Director 

Rate  and  amount  of 
expenditures  toward 
budget  for  that  year 

Administrative 
(discretionary 
act) 

r  Wij  L/irecuor 

22 

Contracts:  FWL, 
OEO,  Carnegie 
Corporation,  and 
others 

Stipulating  work  to 
be  done  in  the  Early 
Childhood  Program 

Contracts 
(contracts) 

OEO  and  Carnegie 
Corporation 

FWL 

23 

Three-month  fund- 
ing moratorium 

Review  of  FWL  activ- 
ities 

Administrative 
(regulation)  "  ■ 

USOE 

FWL 

24 

Exe  cu t i ve  Panel 
recommendations 
for  priority 
programs,  1966 

Development  of 
Teacher  Education 
and  Communication 
program  materials 

Adminis  t  ra  t ive 
(guidelines) 

FWL  Execu  tive 
Panel 

FWL  staff 

25 

USOE  emphasis  on 
service 

Direct  services  to 
districts  served  by 
FWL 

Administrative 
(discretionary 
act) 

USOE 

FWL 
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Number 

Policy 

Substance 

Type 

Source 

Target 

26 

Personnel  Manual 

Recruitments^  hir- 
ing,  firing;  compen- 
sation and  benefits; 
staff  advanceme  nt ; 
professional  activi- 
ties 

Administrative 
(regulations) 

FWL  management 

FWL  staff 

27 

Title  VI 

Prohibits  discrimin- 
atory employment 
practices  in  feder- 
ally supported  in- 
stitution 

S  tatu te 
(enactment) 

U*  S*  Congress 

FWL 

28 

Executive  Order 
11246 

Prohibits  discrimin- 
ation in  hiring 
practices 

Administrative 
(discretionary 
act) 

President' s 
Office 

FWL 

29 

Office  of  Equal 
Employment  Op- 
portunities 
guidelines 

Specifies  unlawful 
practices;  indicates 
equitable  employment 
practices 

Administrative 
^guidelines' 

EEO 

FWL 

30 

Guidelines  for 
preparation  of 
contracts,  em- 
ployment sec- 
tion 

Nondiscriminatory 
employment  practices 

Administrative 
(guidelines) 

Department  of 
Labor,  Office 
of  Federal  Con- 
tracts Compli- 
ance 

FWL 

31 

Policy  on  limited 
copyright  protec- 
tion^  1968 

Providing  limited 
copyright  protection 
for  FWL  materials 

Administrative 
(regulations) 

USOE 

FWL 

32 

Guidelines  on  au- 
thorizing copy- 
right protection 
for  materials  de- 
veloped under 
federal  grants 
and  contracts 

Securing  copyright 
protection;  develop- 
ing thin  markets; 
producers  in  devel- 
opment; royalties; 
developmental  copy- 
right protection 

Administrative 
(guidelines) 

USOE 

FWL 

33 

Contracts  with 
various  agen-» 
cies— NIE,  OEO, 
Carnegie  Corpora- 
tion, and  others 

R&D  activities  as 
specified  in  RFPs 

Contracts 
(contracts) 

NIE,  OEO, 
Carnegie  Corpor- 
ation^ and 
others 

FWL 

34 

Reduction  (15%) 
in  NIE  continua- 
tion contract 
funds 

Reducing  amount  of 
funding  for  Mini- 
course  research  and 
other  projects 

Administrative 
(discretionary 
act) 

NIE 

FWL 

35 

USOE  rating  of 
FWL  as  indepen- 
dent, 1968 

Establishing  finan- 
cial status  of  FWL 

Administrative 
•(discretionary 
act) 

USOE 

FWL  , 

JO 

General  provis ibns 
for  negotiated 
cost-plus- fixed- 
fee  contract 

Reports  of  meeting 
obligations;  de- 
faults; delays 

Administrative 
(guidelines) 

UbUb 

FWL 

37 

Fee  guidelines 
for  cost-plus- 
fixed-  fee  fed- 
eral contracts 

Setting  fees  al- 
lowable for  FWL 
operations 

Administrative 
(guidelines) 

USOE  • 

FWL 
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Number 

Policy 

Substance 

Type 

Source 

Target 

38 

Federal  procure- 
ment regulations 

Prohibiting  use  of 
contract  funds  for 
writing  proposals 

Administrative 
(regulations) 

Department  of 
Labor 

FWL 

39 

Director  recom- 
mendations to 
Board  on  FWL 
reorganization 

Establishing  new 
organizational 
structure  for  FWL 

Administrative 
(discretionary 
act)  * 

FWL  Director 

FWL  staff 

40 

FWL  Board  of 
Director' s  res- 
olution on  ALD 
responsibilities 

Each  ALD  shall  spend 
25*/.  of  time  on  Di-  - 
rector's  Council  and 
757,  on  line  func- 
tions 

Administrative 
(regulations)  * 

FWL  Board  of 
Directors 

FWL  associate 
directors 

41 

Administration 
monitoring  policy 
for  contract 
compliance 

Oversight  and  re- 
porting on  meeting 
all  contract  re- 
quirements 

Administrative 
(guidelines) 

FWL  administra- 
tion 

.  FWL  Pis 

42 

Initiation  of 
Management  Di- 
rective and  oper- 
ate ig  procedures 

Establishes  new  sys- 
tem of  FWL  proce- 
du  res 

Administrative 
(discretiona ry 
act) 

FWL  management 

FWL  staff 

.  43 

NCERD  master 
panel  recommenda- 
tions for  all  FWL 
programs 

Work  on  all  FWL 
projects  since  1972; 
stop  development  and 
start  Minicourse 
testing 

Administrative 
(guidelines) 

NCERD  Transition 
Task  Force  mas- 
ter panels 

FWL 

44 

Specialist  Panel 
C  recommendations 
on  FWL  effective 
teacher  education 

Begin  evaluation 
using  pupil  out- 
comes; include  more 
evaluation;  com- 
plete  all  products 
under  development; 
hold  work  on  all 
products  not  at  MFT 
stage 

Administrative 
(discretionary 
act) 

NCERD  specialist 
panel 

FWL 

45 

NCERD  master 
panel  program 
classifications 
for  FWL 

Classified  each 
program  according 
to  funding  cate- 
gory; determined  . 
amount  of  NIE  funds 
each  program  re- 
ceived 

Administrative 
(discretionary 
act) 

NCERD  Transition 
Task  Force  mas- 
ter panel 

FWL 

46 

FWL  appeals  on 
master  panel 
classif ications-- 
Early  Childhood, 
Home-School  Link- 
age, Information- 
Utilization 

Presenting  arguments 
and  evidence  to 
demonstrate  three 
programs  were  well 
established  at  FWL 

Administrative 
(discretionary 
act) 

FWL  division 
heads 

NCERD  master 
panel 

47 

Letter  from 
Dr.  Tucker  up- 
holding classifi- 
cation of 
Information- 
Utilization  pro- 
gram 

Information- 
Utilization  classed 
as  new  start;  funds 
cut  off  for  this 
program 

Administrative 
(discretionary 
act) 

Director,  NCEHD 
Task  Force  ' 

Division  Head, 
Information- 
Utilization 
Program 
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Number 

Policy 

Substance 

Type 

Source 

Target 

48 

Letter  from 
Dr.  Tucker: 
uti.li.Zcit'ion  3c~ 
tivities  to  be 
addenda  to  pro- 
gram plans 

Including  plans  for 
utilization  as  ad- 

plans 

Administrative 
(discretiona ry 
act ) 

Director,  NCERD 
Task  Force 

FWL  division 
heads 

49 

Master  panel  dis- 
cretionary de- 
cision:    no  ad- 
denda considered 

No  funds  for  utili- 
zation of  FWL  prod- 
ucts provided  by 
NIE 

Administrative 
(discretionary 
act) 

NCERD  Task 
Force,  master 
panel 

FWL 

50 

FWL  Board  of  Di- 
rector's resolu- 
tion establish- 
ing a  new  ALD  in 
charge  of  ser- 
vice, February 
L973 

Establishing  new  ALD 
to  run  ijervice  ac- 
tivities for  local 
schools 

Administrative 
(discretionary 
act) 

FWL  Board  of 
Directors 

FWL  Director 

51 

Notice  of  termin- 
ation to  employ- 

Est£iblishing  a  one- 
month  period  of 
no ti-C6  foLL owi. 
termination  of  eva- 
ployment 

Administrative 
(regulations) 

FWL  management 

FWL  staff 

52 

¥\-rL  fixed-term 
6nipLo^ni3nt  cori" 
tracts 

Establishing  a 
fixed—  te  rill  for  Fl'fij 
employment ;  employ- 
ment conditions  are 
negotiable 

Administrative 
( regu la t  ions ) 

FWL  management 

tWL  employees 

53 

Affirmative  Ac- 

t"inn  f^iiiiHolinoc 

Establishing  quotas 

gories  of  minori- 
ties 

Administrative 
(  gu  i.de  1  me  s  ) 

Office  of  Fed- 
eral Contracts 
Compliance 

FWL 

54 

Affirmative  Ac- 
tion Guidelines 

Hiring  minorities 
based  on  employment 
statistics  for  the 
employment  area 
served  by  FWL 

Administrative 
(guidelines) 

Department  of 
Labor,  Office  of 
Fede  ra 1  Con— 
tracts  Compli- 
ance 

FWL 

55 

Employment  area 
for  FWL 

Redefining  the  FWL- 
employment  area  from 
the  Bay  Area  to  the 
City  of  San  Fran- 
cisco 

Administrative 
(guidelines) 

Human  Rights 
Commi  s  si  on 

FWL 

56 

FWL  appeal  to 
Human  Rights  Com- 
mission ruling  on 
employment  area 

Changing  the  FWL  em- 
ployment area 

Administrative 
(order) 

FWL 

Human  Rights 
Commission 

IV-61 


180 


Annex  B 


TAXONOMY  OF  POLICIES  CONSIDERED  SIGNIFICANT  IN  THE  STUDY 
OF  THE  EVOLUTION  AND  OPERATION  OF  FWL 
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I  INTRODUCTION 


Instances  of  successful  R&D  products  do  not  abound.     The  path  from 
basic  research  to  development  of  a  product  based  on  that  research  to 
widespread  use  of  that  product  **in  the  field"  is  arduous  at  best.  More 
often  than  not  the  linkage  in  this  chain  is  broken  at  some  point  so  that 
educational  practice  remains  unaffected  by  research  and  development  ef- 
forts.    One  instance  of  an  innovation  that  traversed  this  path  success- 
fully is  the  Far  West  Laboratory's  (FWL)  teacher  training  product,  the 
Minicourse.     The  general  utility  of  the  Research- Deve lopment- Dissemination- 
Adoption  (RDDA)  sequence  stands  in  doubt  today,  but  the  -  development  of 

Minicourses  is  an  almost  classic  example  of  this  sequence  and  of  this 

/ 

strategy  of  educationajL^  change.     The  basic  research  on  microteaching 
occurred  at  the  Stanford  University  R&D  Center;  FWL  established  a  liaison 
with  the  R&D  Center  and  translated  the  concept  of  micro  teaching  skills 
into  an  educational  product.     FWL  also  engaged  in  dissemination  activities 
while  Macmillan  Company  marketed  the  product,  and  from  1969  to  the  present, 
more  than  -1000  minicourses  have  been  sold  or  rented.     A  case  study  of  the 
Minicourse  is  of  interest  because  it  has  had  widespread  use,  represents 
a  classic  R&D  strategy,   and  provides  access  to  the  interactions  of  a  num- 
ber of  important  R&D  agents. 

The  purpose  of  this  analysis  Is-  to  trace  the  development  of  the  Mini- 
course  from  the  idea  stage  through  its  use  in  school  districts,  noting 
the  various  interactions  and  configurations  of  agents,  policies,  activities, 
and  resources,   and  to  identify  the  factors  that  are  believed  to  influence 
most  its  utilization.     With  this  case  study  we  hope  to  assess  the  adequacy 
of  the  analytic  framework  as  an  aid  to  understanding  how  a  given  EKPU 
activity  functions  in  relation  to  its  relevant  policies  (requiring  analysis 
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of  the  interactions  of  system  elements--policies,  agents,  activities, 
resources--through  time,  across  levels  of  scope,   and  frequency  using 
several  foci  of  analyses) •     We  wish  to  test  complex  use  of  the  analytic 
framework  for  its  feasibility  and  for  the  insight  it  provides  into  an 
EKPU  activity. 

A  number  of  sources  provided  data  for  this  study.     Interviews  with 
staff  at  the  Stanford  R&D  Center  and  at  FWL,  with  representatives  of 
Macmillan  Company,  and  with^^a  number  of  district  and  county  administra- 
tors who  purchased  or  rented  Minicourses  were  particularly  informative. 
The  other  primary  sources  were  papers,  memos,   program  plans,  correspondence 
and  the  like  at  FWL.     A  principal  agent  not  consulted  directly  was  the 
Office  of  Education,   which  sponsored  the  Minicourse  development  work; 
this  has  resulted  in  a  lack  of  perspective  on  Minicourse  development  be- 
cause there  is  no  federal  point  of  view  to  balance  the  perceptions  of 
local  and  regional  agents. 
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II    USE  OF  THE  ANALYTIC  FRAMEWORK 


To  properly  acknowledge  the  difficulty  in  applying  the  framework  to 
Minicourses  as  a  topic^   and  to  indicate  our  resolution  of  the  problem^  we 
preface  this  case  study  with  remarks  on  the  use  of  the  analytic  framework. 
What  follows  are  some  comments  on  the  feasibility  of  carrying  out  a  com- 
plex analysis  of  this  topic. 

In  general,   the  analytic  framework  is  a  tool  having  a  number  of  func- 
tions related  to  the  various  aspects  of  policy  research.     It  may  aid  in 
the  collection  of  data,   in  the  process  of  conceptualizing  on  EKPU  activity, 
in  the  organization  and  presentation  of  information,   and  in  the  process 
of  interpretation  and  hypothesis  formation.     Our  experience  in  this  case 
was  that  the  framework  served  some  of  these  purposes  better  than  others. 
The  analytic  framework  well  served  the  initial  stages  of  data  collection 
and  conceptualization  of  the  topic.     The  collection  of  information  pro- 
ceeded on  a  basis  established  by  the  four  system  elements,   for  example: 
What  were  the  activities?     What  agents  were  involved?     What  policies  had 
what  effects  on  activities  and  agents?  What  resources  were  available? 
Likewise,   in  a  process  less  easy  to  specify,   the  analytic  framework  in- 
formed our  thinking  as  we  approached  the  topic.     It  proved  useful  first 
in  that  process  of  selective  awareness  through  which  tacit  judgments  are 
made  concerning  salient  facts.     Moreover,   it  aided  exploratory  attempts 
to  construct  relationships  among  facts  relevant  to  the  case,   i.e.,  to 
perceive  interactions  among  elements  and  to  begin  to  establish  the  sig- 
nificance of  these  complex  relationships. 

At  this  stage  of  inquiry,  however,  use  of  the  framework  produced 
diminishing  returns.     This  is  particularly  true  regarding  the.  part  of  the 

V-3 


190 


case  study  that  dealt  with  dissemination  and  adoption  of  the  Minicourses. 
In  effect,  the  complexity  of  the  case  defied  various  attempts  to  con- 
ceptualize and  represent  it.     We  tried  to  use  graphical  "systems"  diagrams 
to  order  the  domain  under  study,  but  those  graphics  true  to  the  complexity 
of  the  case  became  cluttered  and  served  to  confuse  rather  than  enlighten, 
whereas  our  attempts  at  simple  representation  lacked  sufficient  fidelity 
to  the  facts  to  be  valuable.     The  protlem  faced,   then,  was  one  of  depict- 
ing a  multidimensional  reality  in  two-dimensional  space.     The  variables 
of  policies,   agents,   activities,   and  resources,  each  with  potential  sub- 
components, had  to  be  arrayed  in  varying  relations  to  one  another  along 
the  dimension  of  time  (which  implies  the  representation  of  changes  in 
these  elements  and  their  interactions),  and  across  several  foci  of  anal- 
ysis (at  the  federal  level,   the  regional  level,  and  the  local  level). 
After  reviewing  a  number  of  graphic  devices,  we  concluded  that  in  this 
case  the  problems  of  using  the  framework  to  represent  a  topic  outweighed 
the  advantages.     We  shall,   therefore,  present  what  is  essentially  a  nar- 
rative that  keys  policies  mentioned  in  the  text  to  a  single  chart  (Fig- 
V-1),  which  lists  the  relevant  information  about  each  policy. 

.-Finally,  we  judge  (although  this  is  difficult  to  demonstrate)  that 
the  framework  aided  the  process  of  interpreting  and  drawing  conclusions 
about  this  instance  of  EKPU  develcrpment.     The  framework  helped  focus 
attention  on  significant  aspects  of  the  case  that  might  well  have  gone 
unnoticed.     In  addition,   formal  policy  played  an  important  role  that  we 
are  able  to  demonstrate  here.     In  sum,  our  experience  with  this  topic 
indicates  that  there  are  limiting  instances  of  the  framework's  use  in 
depicting  a  complex  EKPU  activity,  but  that  it  is  nevertheless  helpful 
in  collecting  data,   in  conceptualizing  the  policy-related  dimensions  of 
that  activity,  and  in  reaching  conclusions  about  the  administration  of 
an  EKPU  activity. 
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ERLC 


Note:  The  symbols  "FWL"  and  "N I E"  indicate  the  agent  who  terminated  development  ^ 
of  the  Minicourse  in  each  case. 

FIGURE  V-1    DEVELOPMENTAL  HISTORY  OF  MINICOURSES 
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Ill    SUMMARY  OF  FINDINGS 


Research  and  Development  of  Minicourses 

The  Minicourse,  a  teache'r— ttaining  product  developed  at  FWL,  is 
based  on  Stanford  R&D  Center's  research  and  development  of  microteaching. 
Each  Minicourse  focuses  on  one  microteaching  topic,   such  as  asking  ef- 
fective questions  or  tutoring  in  math.     The  materials  are  primarily  a 
set  of  films  in  which  several  master  teachers  demonstrate  effective  skills, 
handbooks,  and  directions  for  the  teacher  and  coordinator.     Use  of  a  Mini- 
course  entails  reading  the  materials,  viewing  the  film,  and  then  teaching 
several  practice  lessons  which  are  videotaped.     The  teacher  reviews  each 
lesson  on  videotape  and  evaluates  his/her  efforts  at  mastering  the  Mini- 
course  skills  based  on  ciiteria  set  forth  in  the  printed  materials.  The 
theoretical  concepts  of  modeling  and  feedback  form  the  basis  for  this 
approach  to  teacher  education.     Seven  Minicourses  were  eventually  mar- 
keted by  Macmillan  Company,   the  commercial  distributor,  and  two  others 
are  now  being  marketed  by  other  agencies. 

Table  V-1  summarizes  the  chronbllDgy  of  key  events  in  the  development 
and  marketing  of  the  Minicourses,  and  Figures  V-2  and  V-3  show  the  prin- 
cipal flows  and  agents.     Minicourses  represent  almost  classic  RDDA  develop- 
ment.    The  process  started  with  the  opening  of  the  R&D  centers  in  1965 
and  the  regional  educational  laboratories  (RELs)  in  1966.     Funding  came 
from  USOE  to  both  the  Stanford  R&D  Center  and  FWL;  these  two  institutions 
then  collaborated,  with  the  information  flow  from  the  Stanford  R&D  Center 
to  FWL  becoming  the  basis  for  Minicourse  development. 

This  collaboration  was  both  formal  and  informal.     The  head  of  the 
Stanford  R&D  Center,  Dr.  R.   Bush,  sat  for  several  years  on  the  now 
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CHRONOLOGY  OF  KEY  EVENTS  IN  THE  DEVELOPMENT  OF  MINICOURSES 


Year 


Key  Events 


1963 
1965 

1966 

1967 
1968 

1969 

1969 
1970 
1970 


1971 


1971 


1972 


1972 


1974 


1975 


Mlcroteaching  was  developed  as  part  of  the  Stanford  University  teacher  training  program. 

Stanford  R&D  Center  was  founded  under  the  Cooperative  Research  Program  of  USOE,  with  $3.5  million 
for  the  first  five  years.     Mlcroteaching  was  an  important  focus  for  the  Center's  early  research. 

"FWL  was  established  under  Title  IV  of  ESEA  through  a  Joint  Powers  Agreement.  A  needs  assessment  of 
the  region  served  by  FWL  and  a  conference  on  instructional  methods  and  teaching  behavior  helped  es- 
tablish in-service  teacher  training  as  one  of  the  top  four  priorities. 

\ 

The  Teacher  Education  Program  was  started  at  FWL,  and  Minicourse  1  was  initiated.  . 

Copyright  policy  was  changed  to  provide  limited  copyright  coverage  for  items  such  as  FWL  produces, 
particularly  Minicourses. 

FWL  signed  a  contract  with  Macmillan  Company  to  begin  work  on  production,  promotion,  and  distribu- 
tion of  Minicourses.     Seven  Minicourses  were , licensed  to  Macmillan  over  the  next  six  years.  Cer- 
tain contractual  stipulations  required  Macmillan  to  promote  and  sell  Minicourses  in  toto  and  to 
allow  review  of  all  promotional  materials  by  FWL, 

The  Utilfzation  Division  established  at  FWL  signified  FWL' s  active  entry  into  the  field  of  dis- 
semination and  utilization. 

A  new  copyright  policy  established  in  the  Federal  Register  allowed  developmental  copyright  privi- 
leges and  generally  offered  further  protection  to  potential  sellers  of  FWL  products. 

Macmillan  released  the  first  Minicourse.     Over  the  next  several  years,   a  number  of  factors  influ- 
enced sales.     The  interpretation  of  Title  I  requirements  by  states  had  an  impact:     in  Los.  Angeles, 
Minicourses  were  purchased  under  Title  I;  in  Wisconsin,  Minicourses  were  not  allowed  under  Title  I. 
Cooperative  funding  arrangements  stimulated  purchase.     At  the  district  level,   the  policy  and  bud- 
get allocations  for  in-service  training  and  release  time  for  teachers  had  an  impact.     The  dissemin- 
ation efforts  by  Macmillan  and  later  by  FWL  were  instrumental  in  sales/rentals. 

FWL's  Utilization  Division  made  several  efforts  to  stimulate  dissemination  of  Minicourses.  Under 
a  separate  contract  with  NCEC,   six  demonstration  centers  were  set  up  around  the  country,  were  op- 
erated in  1971-72,  and  were  reasonably  successful  in  provoking  interest  in  sales. of  Minicourses 
(Nos.  1,  2,   5y  8,  and  9  were  used  at  the  centers).      In  another  effort  with  the  Teacher  Corps, 
three  centers  were  established  to  test  patterns  of  utilization. 

Also  in  1971,   the  Educational  Testing  Service  (ETS)  evaluation  of  educational  products  selected  two 
Minicourses  (Nos.  1  and  5)  from  among  the  nine  final  products  that  survived  evaluation.    The  prin- 
cipal effect  of  this  evaluation  on  the  Laboratory  and  the  Minicourse  was  informal;   it  probably  en- 
hanced the  reputation  of  FWL  and  influenced  the  flow  of  funds  to  the  Laboratory,  particularly  with 
regard  to  the  contract  for  the  Minicourse  demonstration  project. 

NIE  was  established.    The  principal  shifts  in  priority  and  funding  occurred  here.     Based  on  the  re- 
port by  Panel  C  for  NIE,  guidelines  were  sent  to  FWL  requiring  the  following  changes:     (1)  begin 
systematic  evaluation  of  effects  of  Minicourse  training  on  student  outcomes,   (2)  complete  pr.oducts 
that  have  reached  the  main  field  test  stage,  and  (3)  terminate  development  on  all  other  Mini- 
courses.     These  requirements  caused  a  profound  rearrangement  at  FWL:     personnel  were  reassigned, 
hired,  or  fired.     There  was  also  a  switch  to  program  purchase,  and  separate  contracts  were  nego- 
tiated for  the  work  of  evaluation.     One  contract  for  1973-75  covered  the  chief  work  of  evaluating 
pupil  outcomes  baaed  on  Minicourse  training.     The  revised  Resource  Allocation  Management  Plan 
(RAMP)  reflected  the  work  to  be  done  and  the  funds  allocated  for  each  part  of  the  work. 

FWL  made  several  other  distribution  attempts.     Paul  Amidon  Associates  distributed- the  Minicourse, 
"Interaction  Analysis,"  revised  under  Dr.  N.  Flanders  at  FWL;  negotiations  were  conducted  with  the 
Agency  for  Instructional  TV  for  "Discussing  Controversial  Issues";  NEA  arranged  to  distribute  "Role 
Playing  in  the  Upper  Elementary  Grades;"  and  FWL  cooperated  with  the  Organization  for  Economic  Co- 
operation and  Development  (OECD)  in  an  experiment  entailing  transfer  of  Minicourses  to  several 
European  universities. 

NIE  distributed  an  RFP  for  a  study  of  dissemination  of  educational  products;.     FWL  submitted  a  pro- 
posal but  did  not  win  the  contract,  which  effectively  ended  the  Laboratory's  efforts  to  disseminate 
Minicourses. 

Funding  for  Minicourse  research  was  cut  by  157..    Certain  projects  were  terminated  or  scaled  down. 
The  final  report  on  the  effects  of  Minicourses  on  students  was  scheduled  for  the  fall  of  1975., 
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FIGURE  V-2    KPU  AGENTS  AND  FLOWS  IN  THE  RESEARCH  AND  DEVELOPMENT  OF 
THE  MINCOURSE  METHOD  OF  TEACHER  RETRAINING 
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FIGURE  V-3    PRINCIPAL  FLOWS  AND  AGENTS  IN  THE  DISSEMINATION  AND 
ADOf'TION  OF  MINICOURSES 

defunct  FWL  Executive  Panel,  which  was  charged  with  reviewing  and  select- 
ing programs  and  projects  for  development.     A  second  formal  element  was 
the  several  joint  committees  that  worked  on  the  developmetlt  of  the  initial 
Minicourse  materials.     Informally,   there  was  a  good  deal  of  correspondence 
and  mutual  advising  back  and  forth,  basfed  on  a  number  of  personal- 
professional  relationships. 

At  its  inception,  FWL  conducted  a  needs  assessment  in  the  region  it 
served.    This  assessment  became  a  principal  input  to  the  Executive  Panel 
deliberations  that  determined  the  Laboratory's  early  programs.    The  in- 
service  education  of  teachers  emerged  as  a  critical  need,  and  consequently 
the  Teacher  Education  Program  was  created  under  Dr.  Walter  Borg,  with 
Minicourse  development  being  the  principal  task  of  this  division. 

Under  FWL  policy,  the  principal  investigator  had  ^wide  discretion  in 
the  conduct  of  his  program.  In  the  case  of  Minicourses,  Borg  instituted 
a  careful  developmental  sequence  that  called  for  drawing  up  an  initial 
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plan  with  supporting  theory  and  research,  producing  each  course  in  pre- 
liminary form,   sending  it'  through  three  field  trials  with  revisions  after 
each,  and  finally  releasing  the  course  for  distribution.     The  27  steps  in 
the  developmental  sequence  (as  noted  by  P.  Langer  in  a  paper  presented 
to  the  1969  Convention  of  the  American  Educational  Research  Association) 
are  as  follows: 

•  Research  and  information  collecting 

1.  Review  literature  and  prepare  report* 

•  Planning 

2.  State  the  specific  objectives  or  behavioral  changes  to 
be  achieved  and  plan  a  tentative  course  sequence. 

•  Development  of  preliminary  form  of  product 

3.  Prepare  scripts  for  the  instructional  lessons. 

4»    Prepare  teacher  handbook  and  evaluation  forms  for  use 
in  the  microteach  evaluation. 

5.  Prepare  instructional  tapes:     record,  edit,  and  dub. 

6.  Prepare  model  tapes:     record,  edit,   and  dub. 

•  Preliminary  field  testing 

7.  Conduct  preliminary  field  test  in  1  to  3  schools,  using 
4  to  12  teachers. 

8.  Evaluate  results  of  field  test. 

•  Main  product  revision 

9.  Revise  scripts  based  on  preliminary  field-test  results. 

10.  Revise  handbook  and  evaluation  forms  and  print  for  main 
field  test. 

11.  Revise  instructional  tapes:     record,  edit,  and  dub. 

12.  Revise  model  tapes:     record,  edit,   and  dub. 

13.  Prepare  follow-up  package  to  be  used  by  teachers  during 
nine  months'   completion  of  the  course. 
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•  Main  field  testing 

14.  Conduct  field  test  using  a  sample  of  30  to  75  teachers. 

15.  Collect  precourse  tapes  and  postcourse  tapes  of  the 
classroom  behavior  of  teachers  participating. 

16.  Collect  delayed  postcourse  tapes  of  participating 
teachers  from  four  to  six  months  after  completing  the 
course,  ^   

17.  Evaluate  main  field-test  results  to  determine  if  the 
course  meets  the  specific  behavioral  criteria  estab- 
lished for  the  course. 

18.  Distribute  the  evaluated  follow-up  package. 

•  Operational  product  revision 

19.  Revise  course  for  operational  field  test. 

20.  Prepare  complete  implementation  package  including  all 
material  needed  by  a  school  to  conduct  the  course  with- 
out outside  help. 

•  Operational  field  testing 

21.  Train  operational  test  coordinators. 

22.  Conduct  operational  field  test. 

23.  Evaluate  operational  field-test  results. 

m 

•  Final  product  revisions 

24.  Make  final  revisions  in  the  Minicourse  before  mass  dis- 
tribution of  the  course  for  operational  in-seirvice  use 

'  in  the  schools,  .  .. .  —   

•  Dissemination  and  distribution 

25.  Disseminate  and  distribute  course  for  use. 

•  Report  preparation 

26.  Prepare  and  distribute  research  and  development  report, 
giving  results  of  all  field  testing  of  the  Minicourse. 

•  Implementation 

27.  Implement  course  in  the  schools. 
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The  criteria  used  in  the  field  tests  were  changes  in  teacher  behavior. 
This  demanding  quality  control  procedure  was  usually  effective  in  ensur- 
ing the  excellence  of  final  products,  and  an  examination  of  Figure  V-1 
shows  that  a  significant  number  of  Minicourses  failed  to  pass  muster  at 
one  stage  of  development  and  so  were  rejected.     In  addition  to  the  review 
procedures  developed  by  Borg,   there  were  a  number  of  Laboratory  policies 
affecting  the  development  of  each  Minicourse.     In  brief,  each  Minicourse 
received  a  review  by  FWL's  Director,  Executive  Panel,  and  Board  of  Di- 
rectors at  the  proposal  stage  and  reviews  at  several  developmental  stages 
by  the  Program  Director,   culminating  in  a  final  review  by  the  Director 
and  the  Executive  Panel. 

Each. year  Borg,  in  consultation  with  his  staff,  prepared  a  program 
plan  outlining  the  work  to  be  accomplished*     After  a  series  of  internal 
reviews  and  revisions,   this  plan  was  incorporated  in  the  master  plan  sent 
to  USOE  as  the  basis  for  renegotiation  of  the  Laboratory  contract.  Al- 
though Borg  controlled  this  budget- setting  function,   the  initial  choice 
of  a  teaching  skill  around  which  to  develop  a  Minicourse  was  open  to  any- 
one in  the  division.     Preliminary  plans  were  submitted  to  the  Executive 
Panel  for  approv<'il  (as  indicated  above),  followed  by  development  and  re- 
view procedures.     However,  FWL  was  criticized  for  this  aspect  of  Mini- 
course  development;  e.g.,  with  no  overall  plan  of  development,   the  skills 
appeared  unrelated  to  one  another  and  essentially  isolated  from  other 
aspects  of  teaching  behavior.     Responding  to  this  criticism  in  1972,  FWL 
developed  a  long-range  program  plan  based  on  identification  of  "competency 
clusters,"  i.e.,  groups  of  related  teaching  skills.    With  the  switchover 
to  NIE,  however,   this  approach  was  dropped  and  has  not  been  further  pur- 
sued at  the  Laboratory. 
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Dissemination  and  Adoption  of  Minicourses 

Confronted  with  the  problem  of  how  to  market  and  distribute  their 
Minicourses,  FWL  decided  to  select  a  commercial  publisher  to  carry  out 
this  aspect  of  the  work.     A  key  agent  in  this  decision  was  FWL's  Fred 
Rosenau,   whose  background  in  the  publishing  industry  provided  expertise 
in  the  Laboratory's  negotiations  with  the  ultimate  publisher,   the  Mac- 
millan  Company. 

FWL  sent  out  an  RFP  and  on  this  basis  selected  Macmillan  (the  only 
publisher  to  respond).     A  principal  concern  at  this  juncture  was  copy- 
right protection,   then -lacking  for  FWL  products.     However,   in  1968  the 
Laboratory  was  ins truinental  in  changing  USOE  copyright  guidelines  so  thai: 
copyright  protection  could  be  obtained.     This  facilitated  the  contract 
with  Macmillan  in  1969,  and  over  the  next  several  years  seven  Minicourses 
were  licensed  to  Macmillan.     The  principal  policies„  regulating  this  ex- 
change were  the  copyright  laws,  and  the  contracts  between  FWL  and  Mac- 
millan. 

Gradually,  FWL  realized  that  Minicourses  were  a  difficult  product 
to  disseminate,   and  that  a  publishing  company  whose  main  sales  were  text- 
books would  have  trouble  selling  an  innovation  requiring  use  of  audio- 
visual media  for  in-service  training  purposes.     The  Laboratory  then  became 
actively  engaged  in  dissemination  and  utilization  activities,   their  prin- 
cipal effort  being  the  Minicdurse  demonstration  centers  project  funded 
under  contract  to  NCEC  in  1971.     The  six  centers  established  attracted 
many  visitors  and  stimulated  interest  and  sales/rentals  of  Minicourses 
during  the  year  they  were  in  operation. 

A  major  event  in  the  development  of  Minicourses  occurred  with  the 
establishment  of  NIE  in  1972.     New  guidelines  from  NIE  based  on  their 
Panel  C  recommendations  shifted  priorities  at  the  Laboratory  from  further 
development  and  dissemination  efforts  to  an  evaluation  of  existing 
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Minicourses  by  using  student  outcome  measures.     A  new  contract  with  NIE 
extending  from  1973  through  1975  determined  the  nature  and  scope  of  this 
effort.     This  new  policy  direction  had  an  extensive  impact  on  FWL  and 
meant  that  a  number  of  Minicourses  in  various  stages  of  the  development 
sequence  were  simply  shelved  (see  Figure  V- 1) .     Finally,  ^n  19J4,  NIE 
put  out  an  RFP  for  a  dissemination  project  to  which  FWL  responded  but 
failed  to  win. 

The  new  direction  dictated  by  NIE  meant  gearing  up  for  a  research 
program,  which  the  teacher  education  division  at  FWL,  proceeded  to  do. 
Three  developmental  team  directors  and  four  field  coordinators  who  su- 
pervised Minicourse  testing  activities  were  released.     Principal  upper 
level  staff  remained  to  organize  the  research  effort  (Drs.  Flanders,  Ward, 
Berliner,  and  Gall),  and  other  researchers  were  hired.     From  1972  to  the 
present  the  research  program  using  student  outcomes  has  been 'the  main 
activity  of  the  teacher  training  program.     The  final  reports  are  due  in 
the  fall  of  1975. 

Under  the  revised  work  plan  submitted  to  NIE  in  1972^   there  was  pro- 
vision to  carry  out  some  work  in  progress  on  the  Minicourses,  and  this 
work  continued  beyond  1972.     Under  Dr.  Flander's  leadership,   the  Mini- 
course  on  interaction  analysis  was  modified  and  licensed  to  Paul  Amidon 
Associates  for  distribution.     In  this  case,   the  Laboratory  experimented 
with  a  reduced  Minicourse  kit  that  did  not  include  a  film  and  that  could 
be  sold  in  parts.     The  Minicourse  ''Discussing  Controversial  Issues"  was 
licensed  in  1975  to  the  Agency  for  Instructional  Television  to  distribute 
after  a  protracted  series  of  negotiations,  and  NEA  became  interested  in 
completing  development  of  ''Role  Playing  in  the  Upper  Elementary  Grades." 
In  this  latter  case,   the  Laboratory  did- not  have  the  means  to  finish  the 
development  task,  and  so  it  simply  turned  over  this  course  to  the  NEA 
without  securing  any  contracltual  obligations. 
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An  interesting  spin-off  of  the  Minicourse  program  has  been  a  project, 
initiated  by  OECD/CERI*  at  conferences  in  1971  and  1972,   that  is  still  in 
progress  at  several  locations.     This-  project  is  an  experiment  in  the  inter- 
national transfer  of  several  Minicourses  to  nine  universities  in  seven 


European  countries.     FWL  cooperated  in  this  project,  which  received  fi- 
nancial support  from  OECD/CERI,     Each  country  developed  one  or  more  Mini- 
courses  using  the  developmental  procedures  established  by  FWL.     The  project 
produced  some  interesting  evidence  on  the  viability  of  international  trans- 
fer of  educational  innovations  (see  reference  section  for  reports  on  the 
results). 

A  multitude  of  factors  at  two  levels  influenced  the  actual  sales  and 
use  of  Minicourses:     At  Level  I  are  factors  directly  relating  to  an  LEA*s 
purchase  or  rental  of  Minicourses;  at  Level  II  are  factors  that  affect 
Macmillan's  decision  to  market  Minicourses  and  that  are  likely  to  affect 
any  future  publishing  firm^s  decision  to  adopt  a  particular  innovation. 

An  accounting  scheme  for  these  factors  is  shown  below.  Following 
each  factor  is  a  series  of  numbers;  these  are  ratings  from  1  to  3  on  four 
variables,  as  follows: 


RaLlii^s'^  variables 

1  -  Low  Magnitude  of  Factor:     How  powerful  was  the  factor 

in  influencing  the  decision  in  question? 

2  -  Moderate  ^ 

^      jl'  h  How  Easy  to  Change:     How  amenable  to  change  is  this 

factor,  particularly  change's  initiated  by  NIE? 

How  Well  Understood:     How  well  do  we  understand  the 
way  in  which  this  factor  operates  across  different 
settings  and  in  interaction  with  other  factors? 

How  Nomothetic:     Is  this  a  factor  coimnon  to  all,  

many,  or  only  a  few  settings?     Is  its  influence 
based  on  some  institutional  arrangement? 


Cooperative  Educational  Research  Institute. 
^Ratings  are  for  illustrative  purposes  only. 
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LEVEL  I  FACTORS 
Plus  Factors  Minus  Factors 


Macmillan's  promotional  activi- 
ties(a)*   


(2,   3,   3,  3) 


FWL  dissemination  efforts 


(b) 


(3,   2,   3,  2) 


Availability  of  federal  and  state 

(c) 

funds  for  purchase  of  Minicourses^  ^ 

(3,  i,  1,  1) 


Existence  of  cooperatives  or  con- 
sortia^^^  


(3,   3,   2,  2) 


Minicourses  as  prestige  item  for 


publishers 


(e) 


(1,   3,  I,  2) 


Character  of  product:  impersonal, 
individual,  nonthreatening  ^ 
(1,  3,  1,  3) 


LEA  budget  and  policy  regarding 
in- service  training(^) 


(3,  2,   2,  1) 


Initial  attitudes  of  teachers  and 
teacher  unions  to  Minicourses 


(2,   3,   2,  2) 


Availability  of  necessary  equipment, 
especially  VTRs^^^  


(3,  3,   3,  2) 


Reluctance  of  salespersons  to  de- 
vote time  and  effort  to  sell  Mini- 


courses 


(3,   2,   3,  3) 


Pressure  on  key  administrators  to 
innovate:  prevented  further  pur- 
chase of  Minicourses^-^  ^ 


(1,  2,  I,  2) 
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Plus  Factors 


Minus  Factors 


Administrative  organization  at 
local  level:     no  one  Was  in  charge 
^  of  in^'service  training^  ' 


(2,   1,  2,  3) 

Resistance  of  teacher  training  in- 
stitutions to  Minicourses:  Macmil- 
lan  as  K-12  distributor^^) 


(3,    ly    ly  3) 


Chs 


laracter  of  product:  "handi 

^  on"W  

(2,  2,  1,  3) 


Is- 


(a)  Macmillan's  promotional  activities  consisted  of  descrip- 
tive brochures  and  catalogs  for  mailing,  preview  kits 
mailed  to  LEAs  on  request  for  a  six-week  period  (con- 
taining films,  materials,  and  so  on),  exhibits  at  ap- 
propriate conventions,  and  demonstrations  around  the 
country. 

(b)  Dissemination  efforts  included  establishing  six  demon- 
stration centers  around  the  country  in  1971-72,-  field 
test  sites,   a  cooperative  project  with  Teacher  Corps 

in  three  sites  in  1971-72,  and  some  cooperative  activi- 
ties with  a  consortia  of  laboratories  including  CEMREL, 
NWREL,  and  Wisconsin  R&D. 

(c)  Primarily  Title  I  funds  were  used,  e.g.,  in  Los  Angeles, 
but  in  Wisconsin  purchase  of  Minicourses  was  not  allowed 
under  Title  I.     In  Texas,  Minicourses  were  purchased  by 
federal  funds  given  to  the  state  for  the  Texas  Education 
Renewal  Center  program.     When  no  outside  funds  were  avail- 
able, there  was  a  diminished  chance  that  Minicourses  would 
be  bought. 

(d)  Cooperatives  were  informal  arrangements  of  school  dis- 
tricts that  put  up  funds  for  purchase  of  materials  and 
products  that  could  be  shared.     These  are  known  as  BOCES 
(Board  of  Cooperative  Educational  Services)  or  CESA  (Co- 
operative Education  Serivce  Agency).     Salesmen  could 
successfully  do  business  with  these  groups  because  they 
could  sell  in  some  volume  and  had  a  central  -authority 
with  which  to  deal. 
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(e)  Although  the  prestige  factor  may  be  minor,  the  Macmillan 
representative  mentioned  that  a  research- supported  innova- 
tion such  as  Minicoyrses  could  enhance  Macmillan* s  pres- 
tige and  gain  an  audience  for  other  products  (which  might 
result  in  the  purchase  of  texts,  not  Minicourses), 

(f)  A  crucial  factor  was  whether  there  were  adequate  funds 
in  the  budget  for  in-service  training.     Teachers  usually 
used  Minicourses  only  during  in-service  hours  which  meant 
release  time  and  funds  for  substitutes--a  hidden  cost  of 
Minicourses, 

(g)  Teachers  and  unions  felt  a  certain  reluctance  to  accept 
Minicourses,     Do  Minicourses  presuppose  that  teachers  can- 
not teach  well  or  are  incompetent?    This  hidden  agenda 
item  made  it  difficult  for  administrators  to  advocate 
Minicourses  to  teachers.     Moreover,  at  teacher  training 
institutions,  professional  educators  rejected  Minicourses 
because  they  had  developed  their  own  methods  of  teacher 
training. 

(h)  Availability  of  equipment  was  a  key  difficulty.     At  the 
time,  many  districts  lacked  access  to  the  necessary  media. 

(i)  In  a  textbook- dominated  industry,  most  salespersons  do  not 
have  the  requisite  skills  or  information  to  sell  media  pro- 
grams, and  they  feared  that  introduction  of  Minicourses  with 
texts  would  create  the  impression  that  teacher  training 

was  necessary  to  the  use  of  texts  and  that  this-  would  dis- 
courage purchase  of  the  text.  Moreover,  selling  Mini- 
courses  was  too  time-consuming;  it  required  that  equipment 
^  be  set  up,  films  run,  elaborate  explanations  be  given,  and 
so  on.  Also,  it  was  an  effort  to  find  the  several  persons 
who  could  make  the  decision  on  Minicourse  adoption;  hence, 
too  great  an  investment  of  time  relative  to  sales  was  re- 
quired. 

(j)    Even  when  there  was  customer  satisfaction  after  initial 
purchase  or  rental  of  Minicourses,  administrators  fre- 
quently did  not  purchase  more  of  them.     A  Macmillan  repre- 
sentative attributed  this  to  the  pressure  on  certain  ad- 
ministrators to  continue  innovating.     When  Minicourses 
became  "old  hat,"  innovative  administrators  lost  interest. 

(k)    Macmillan  frequently  found  that  no  LEA  agent  was  respon- 
sible for  in-service  training.     Thus,   they  found  no  one 
with  the  interest  or  the  authority  to  purchase  the  product. 
Furthermore,  even  if  an  LEA  did  purchase  the  Minicourses, 
no  one  had  administrative  responsibility  for  seeing  that 
it  was  used  by  practitioners. 
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(1)    Macmillan  deals  primarily  with  elementary  and  secondary 
materials.    Free  Press  has  the  college  market  within  the 
company,   so  a  sizable  part  of  the  market  was  ignored  be- 
cause of  the  organizational  structure  of  the  publishing 
company  [see  also  (g)  above]. 

(m)    The  as.sumption  that  Minicourses  could  be  used  without 
demonstration  and  assistance  proved  unfounded.  When 
assistance  was  available  at  the  LEA  in  the  form  of  an 
administrator  to  push  Minicourses  and  to  aid  in  their 
use,   they  were  more  successful  and  more  widely  used. 


LEVEL  II  FACTORS 


Plus  Factors 


Minus  Factors 


Ca) 

Protection  by  copyrights'^  ^ 
(2,  3,  3,  3) 


Pressure  from  LEAs  on  publishers 
to  provide  services,  as  well  as 
A     ^  (b) 

products^  ^   ^  ^ 


(2, 


1,  1, 


3) 


Relative  lack  of  competition  in 

market  of  teacher  training 
(c) 


products 
(2/1,  3,  3) 


Knowledge  of  market  parameters  and 


potential 


(d) 


(3,   3,  1,  3) 


(Short  copyright  duration) 


Allowance  for  greater  interaction 
between  laboratory  and  publisher 
at  development  stages 


(1,  3,  1,  3) 


Contract  stipulations  between  FWL 
and  Macmillan 


(1,  3,   3,  3) 
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Plus  Factors 


Minus  Factors 


Incentives  to  explore  new  mar- 

kets^^^  

(2/  3,  1,  3) 

Federal  policy  respecting  rela- 
tions between  laboratories  and 

distributors   

(1,  3,  1,  3) 


(a)  Before  1968,  products  developed  at  FWL  were  under  public 
domain  ruling.     In  1968  and  1970,  new  copyright  regulations 
in  the  Federal  Register  extended  protection  to  private 
firms  for  limited  periods  of  time.     In  future,  however, 
more  extended  coverage  probably  will  be  needed  if  the  pri- 
vate sector  is  to  continue  promoting,  producing,  and  sell- 
ing laboratory  products, 

(b)  Pressure  from  LEAs  was  quoted  as  a  chief  reason  for  mar- 
keting Minicourses.     LEAs  wanted  services  such  as  consul- 
tation and  more  work  directly  with  teachers.  Macmillan 
may  have  interpreted  this  pressure  as  an  auspicious  sign 
for  Minicourses. 

(c)  There  was  no  market  for  teacher  training  and  it  certainly 
was  not  a  line  item  in  most  LEA  budgets,  but  talk  of 
teacher  education  was  in  the  air  according  to  the  Macmillan 
people  interviewed. 

(d)  Apparently,  Macmillan  gambled  that  a  new  market  was  opening 
•  and  that  chances  were  good  for  outdistancing  competitors  to 

this  new  source  of  sales.     As  far  as  can  be  determined,  how- 
ever, Macmillan  had  no  data  (e.g.,  surveys  and  market  re- 
search) on  the  feasibility  of  teacher  education  materials. 

(e)  Greater  interaction  between  publisher  and  laboratory  was 
insignificant  in  regard  to  Minicourse  adoption,  but  Mac- 
millan indicated  that  in  future  they  will  require  greater 
input  in  product  development  before  adopting  a  product. 

(f)  Contract  stipulations  might  be  placed  on  either  the  plus 
or  minus  side.     FWL  required  that,  they  review  all  promo- 
tional materials  put  out  by  Macmillan  and  stipulated  that 
Minicourse  materials  not  be  sold  separately.  Lengthy 
negotiations  resulted  in  a  series  of  contracts,  so  FWL 
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stipulations  did  not  negatively  affect  adoption;  in  gen- 
eral^ this  policy  will  be  crucial  in  any  future  dealings 
between  laboratories  and  publishing  agents, 

(g)  The  publishing  industry  has  no  great  resources  for  pro- 
motion and  for  the  careful^  systematic  development  of  new 
markets.     Without  Incentives  to  take  on  innovative  products 
and  programs^   they  are  unlikely  to  do  so.     Such  incentives 
may  take  the  form  of  contractual  obligations  for  support 

on  the  part  of  the  federal  government. 

(h)  Recently^  a  provision  has  been  made  for  a  laboratory  to 
choose  a  distributor  to  work  with  before  government  fund- 

•  ing.     In  the  past^   there  was  an  unwritten  policy  against 
collaboration  of  this  sort.     In  the  future^  close  coopera- 
tion may  exist  between  laboratores  and  publishing  , firms 
during  all  phases  of  development  and  dissemination. 

Case  Studies  of  Adoption 

To  complete  an  examination  of  the  total  configuration  of  agents^  pol- 
icies^ resources^  and  activities  for  this  case^  a  survey  of  circumstances 
surrounding  adoption  of  Minicourses  at  the  local  level  is  required.  Fol- 
lowing are  four  case  studies  of  local  adoption  that  c^n  actually  stand  by 
themselves^  but  that  also  suggest  interactions  across  levels  of  analysis. 
These  cases  are  meant  to  illustrate  the  range  of  policies  and  agents  in 
this  topic  rather  than  to  represent  the  full  range  and  variation  of  cir- 
cumstances in  local  adoption  of  an  innovation. 

Case  I:     The  Chicago  Public  School  System 

In  Chicago^  one  of  the  district  superintendents  became  interested  in 
Minicourses^  and  through  his  efforts  they  were  introduced  into  a  number  of 
schools  in  the  Chicago  system. 

In  1969^   the  superintendent  was  invited  to  a  conference  held  by  FWL 
in  Illinois.     He  left  the  conference  convinced  that  Minicourses  were  the 
best  teacher  training  materials  available.     His  determination  to  obtain 
Minicourses  for  Chicago  teachers  rested  on  a  judgment  that  to  improve 

V-22 


208 


education  meant  to  improve  teaching.     He  had  been  seeking  ways  to  do  this, 
and  the  FWL  Minicourses  appeared  to  be  the  best  option.     Through  his  ef- 
forts, five  of  the  Macmillan-produced  Minicourses  were  purchased  over  the 
next  two  years. 

The  task  of  introducing  Minicourses  into  his  district  proved  complex, 
and  demanding.     Use  of  Minicourses  required  funds  for  three  items:  software 
(Minicourse  films  and  manuals),  hardware  (VTRs),  and  salaries  for  substi- 
tute teachers,   freeing  regular  teachers  for  in-service  training.     This  last 
reqtiirement  was  necessary  because  of  the  particularly  strong  and  active 
teacher's  union  in  Chicago.     There  was  no  possibility  that  teachers  would 
work  with  the  Minicourses  on  their  own  time  because  the  union  would  regard 
this  as  an  encroachment  on  teacher  rights — an  extra,  unnegotiated  respon- 
sibility.    Use  of  Minicourses  would  have  to  be  during  school  hours,  based 
on  teacher  release  time  and  coverage  of  their  classes. 

The  Chicago  budget  was  set  up  so  that  funds  for  VTRs  came  out  of  the 
budget  for  furniture  and  equipment,   and  software  materials  out  of  the  bud- 
get for  instructional  materials.     Since  there  was  not  enough  money  in  either 
budget  to  cover  the  necessary  purchases,  the  superintendent  adopted  a  two- 
fold strategy.     First,  he  worked  to  change  the  state  legislative  guidelines 
defining  instructional  materials;  second,  he  attempted  to  include  Mini- 
courses  on  the  list  of  programs  eligible  for  purchase  with  Title  I  funds. 
Each  of  these  maneuvers  entailed  a  series  of  actions  over  the  next  several 
years. 

In  Illinois,   local  school  boards  receive  state  appropriations  that 
form  the  basis  for  the  district  budget.     Governing  these  funds  are  pro- 
visions defining  how  and  for  what  they  may  be  spent.     At  the  time,  the 
definitions  governing  instructional  materials  were  antiquated  and  did  not 
recognize  the  newer  kinds  of  educational  materials  being  developed.  To 
have  these  guidelines  changed^   the  superintendent  worked  with  another  key 
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actor  in  the  Chicago  system,  the  superintendent  charged  with  legislative 
oversight  and  lobbying  at  the  state  and  federal  levels.     This  administra- 
tor worked  full  time  representing  the  Chicago  public  schools  in  Spring- 
field and  in  Washington,  using  input  and  recommendations  from  committees 
within  the  school  system.     By  this  means,   the  district  superintendent  was 
able  to  effect  the  changes  in  the  legislative  guidelines  that  allowed  pur- 
chase of  Minicourses  from  the  instructional  materials  budget.  However, 
this  change  was  not  enough;  the  need  was  for  a  funding  source  that  could 
cover  the  whole  program:     software,  hardware,  and  teacher  time.     To  get 
this,  the  superintendent  turned  to  the  Title  I  program. 

Under  Title  I  of  ESEA,   schools  with  "disadvantaged"  children  (as  de- 
fined by  Title  I  regulations  and  guidelines)  receive  per  capita  appropria- 
tions that  may  be  used  for  the  purchase  of  programs  on  a  list  approved  by 
the  state  board  of  education.     Title  I  requires  that  advisory  councils  of 
community  members  make  the  decisions  on  what  each  school  will  purchase. 
Consequently,  the  superintendent  first  had  to  obtain  permission  from  the 
state  board  of  education  to  place  Minicourses  on  the  approved  list  of 
Title  I  programs.     Next  he  worked  with  the  community  councils  to  encour- 
age selection  of  Minicourses  as  the  basis  for  staff  development.  Since 
these  councils  were  most  interested  in  innovations  that  entailed  use  of 
community  members,  such  as  programs  employing  teacher  aides,  persuasive 
argument  was  necessary.     Eventually,  the  superintendent  was  successful 
in  securing  funds  using  this  tactic. 

The  superintendent  adopted  a  few  other  strategies  as  well.     For  ex- 
ample, he  introduced  a  nonquota  teaching  position  into  two  schools  to 
provide  class  coverage  so  that  teachers  could  use  the  Minicourses.  Each 
school  was  allotted  a  specified  number  of  teachers,  based  on  a  fixed 
student/ teacher  ratio,   so  he  smuggled  part-time  positions  into  these 
schools  to  provide  the  necessary  coverage.     Subsequently,   200  new  posi- 
tions were  negotiated,  i.e.,  a  reading  teacher  was  assigned  to  each  of 
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the  200  elementary  schools  in  Chicago  with  the  lowest  reading  scores,  and 
this  extra  staff  allowed  for  class  coverage  as  well.     Finally,  he  had  the 
maintenance  staff  erect  partitions  in  several  rooms  to  provide  private 
space  for  viewing  the  videotapes.     This  he  felt  was  necessary  to  encourage 
teacher  use,  and  to  alleviate  any  suspicions  that  administrators  might  use 
the  tapes  for  staff  evaluation  purposes. 

In  addition  to  the  determined  efforts  by  this  single  agent,  FWL  was 
instrumental  in  the  adoption  and  utilization  process.     For  two  years, 
representatives  from  FWL  consulted  with  the  superintendent  and  worked 
with  his  teachers.     Moreover,  two  demonstration  centers  in  the  Chicago 
area  created  interest  in  Minicourses  and  brought  their  potential  to  the 
attention  of  teachers.     The  district  superintendent  considered  this  as- 
sitance  from  FWL  to  be  invaluable. 

Case  II:     Montgomery  County.  Maryland  Office  of  Education 

In  the  summer  of  1970,  Dr.  Bruce  Joyce  of  Teachers  College,  Columbia 
University,  alerted  staff  in  the  Montgomery  County  education  office  to 
a  new  teacher  training  product,  the  Minicourse.     (Dr.  Joyce  worked  as  an 
occasional  consultant  to  Montgomery  County  and  later  worked  at  FWL  as  a 
visiting  scholar.)    The  county  board  became  interested,   contacted  the 
Laboratory,  and  agreed  to  participate  in  the  operational  field  testing  of 
several  Minicourses.     In  return,  they  were  allowed  to  use  the  Minicourses, 
and  subsequently  purchased  all  of  those  marketed  by  Macmillan. 

During  their  association  with  FWL,   the  county  board  also  explored 
the  possibility  of  establishing  a  team  of  local  developers  to  create  Mini- 
courses.     FWL  initiated  this  idea  and  suggested  it  to  USOE,  but  the  project 
was  never  attempted.     The  sequel,  however,  was  that  Montgomery  County 
decided  to  develop  their  own  "Minicourse."    The  topic  of  interest  was 
parent/ teacher  conference  skills,  and  by  spring  of  1973  a  pilot  version 
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of  this  course  had  been  prepared,   consisting  of  a  handbook  of  theory  and 
suggestions,  five  taped  lessons,  and  two  tapes  of  model  conferences  (tape 
rather  than  film  was  the  instructional  medium  in  this  case).     The  develop- 
mental sequence  used  at  FWL  was  followed,  but  no  validation  research  was 
conducted.     Montgomery  County  did  conduct  some  evaluation  of  this  product, 
however,  using  the  following  criteria:     Do  the  teachers  use  the  skills 
learned  in  actual  conferences?     Do  conferences,  meet  with  the  approval  of 
parents? 

During  its  first  year,   this  course  was  used  in  Montgomery  County  at 
roughly  the  same  rate  as  the  commercial  Minicourses.     This  local  develop- 
ment project,  then,   is  considered  a  success,  but  Montgomery  County  staff 
report  they  will  probably  not  develop  another  course.     The  effort  and  re- 
sources entailed  were  considerable,  and  the  county  feels  that  in  the  future 
such  activities  would  be  too  demanding. 

Case  III:     The  Houston  Unified  School  District 

The  Houston  School  District  has  purchased  and  used  all  seven  of  the 
Minicourses  sold  through  Macmillan.     In  this  case,  it  is  the  funding  ar- 
rangement and  factors  affecting  use  or  nonuse  that  are  of  interest,  Texas 
has  recently  established  a  number  of  regions,  each  served  by  a  regional 
service  center.     The  funds  that  each  school  district  in  a  region  contri- 
butes to  the  regional  center  are  matched  by  the  state.     All  districts 
belong  to  a  region,  but  three  districts — Houston,  Dallas,  and  Dallas 
County-~are  large  enough  to  provide  their  own  services.  Consequently, 
they  have  only  a  satellite  relationship  with  the  regional  areas. . 

Macmillan  introduced  Minicourses  to  the  Houston  district  through  a 
demonstration  held  for  Harris  County  schools  (in  addition  to  regions, 
there  are  also  county  offices  of  education).     Specialists  from  the  Depart- 
ment of  Instructional  Services  recommended  purchase  of  the  Minicourses, 
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and  the  director  of  the  Department  approved.     Based  on  their  relationship 
with  Region  4^  Houston  purchased  the  Minicourses  with  regional  matching 
funds. 

Since  1970,  Houston  has  tried  a  number  of  staff  development  arrange- 
ments to  encourage  Minicourse  use.     Initially,  teams  of  ''teaching  strate- 
gists" moved  from  school  to  school  consulting  with  teachers,  and  provided 
service  and  in-service  training.    More  recently,  a  "mini  university"  set 
up  in  the  district  offered  courses  for  teachers.     In  return  for  attending 
these. after-school  courses,  teachers  received  credit  toward  "compensation 
days,"  which  was  time  off.    Most  recently,  a  new  staff  development  pro- 
gram has  discontinued  the  compensation- day  concept,  and  now  teachers  and 
principals  may  individually  request  Minicourses  for  use. 

Other  factors,  J.n  addition  to  teacher  strategists  and  the  mini  univer- 
sity, encouraged  Minicourse  use,  e.g.,  needs  assessments  conducted  by 
school  principals,  which  resulted  in  programs  for  teachers  of  those  schools. 
A  variety  of  factors,  however,  were  reported  by  the  media  specialists  in 
Houston  as  inhibiting  adoption  of  Minicourses: 

•  Lack  of  VTRs. 

•  Lack  of  an  agent  to  promote  use. 

•  Teacher  attitude,  e.g.,  disappointment  for  those  teachers 
who  wish  immediate  application,  or  lack  of  motivation  for 
some  teachers  to  follow  a  Minicourse  to  completion. 

Houston  administrators  saw  group  process  as  a  crucial  aspect  of  Mini- 
course  use.     Participating  in  Minicourse  training  as  a  group  provided 
better  motivation  and  social  reinforcement  for  teachers.     The  best  use 
strategy,   they  felt,  was  a  mixture  of  individual  work  (e. g. viewing  tapes 
of  one's  own  performance)  and  group  feedback  and  support  (e.g.,  discussing 
the  results  of  this  viewing  in  a  group). 

-    ~  '  V-  27  


ERLC 


2i3 


Case  IV;     Alameda  County,  California 

The  Alameda  County  Office  of  Education  is  located  in  the  region 
served  by  FWL  and  expressed  an  early  interest  in  the  Minicourses  after  a 
demonstration  conducted  by  the  Laboratory;  county  administrators  arranged 
for  loans  of  Minicourses  for  the  first  year,  followed  by  purchase  in  the 
second  year.     The  funds  came  from  the  county  curriculum  materials  budget, 
and  each  Minicourse  was  subject  to  an  informal  review  process  established 
by  the  county;  i.e.,  the  Minicourse  was  sent  to  teacher  evaluation  com- 
mittees in  the  various  districts  served  by  the  county.     Based  on  their 
reports,  the  county  agent  made  recommendations  to  the  County  Purchasing 
Committee,  and  if  funds  were  available,  the  materials  were  purchased. 

The  County  Office  stimulates  use  in  a  number  of  ways: 

•  FWL  in  connection  with  Alameda  County  has  arranged  for 
credit  to  be  offered  for  Minicourse  training  through  St. 
Mary's  College.     School  principals  coordinate  this  effort, 
which  is  optional  but  ties  in  the  salary  schedule. 

•  Minicourse  films  are  delivered  directly  to  the  school. 

•  In  some  cases,  release  time  is  provided  by  the  schools 
for  teachers  to  engage  in  Minicourse  training. 

According  to  the  county  agent,   the  informal  communication  network 
among  principals  in  the  county  is  also  important  in  fostering  Minicourse 
use.  ^ 

The  chief  impediment  has  been  the  unavailability  of  VTRs,  but  as  more 
districts  obtain  this  equipment,  Minicourse  use  has  risen.     Alameda  County 
has  now  used  six  of  the  Minicourses  produced,  and  apparently  the  loan/ 
purchase  option  has  been  a  favorable  arrangement  between  FWL  and  Alameda 
County,  and  has  encouraged  the  trial  use  of  Minicourses  before  actual  pur- 
chase from  Macmillan. 
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Suimnary  of  Adoption  Case  Studies 

Most  striking,  perhaps,  about-  the  case  studies  described  above  is 
the  diversity  of  circumstances  encountered.     Any  generalizations  must  be 
balanced  against  the  idiosyncratic  features  peculiar  to  each  case  of 
adoption  and  those  that — based  on  these  few-- should  be  expected  elsewhere. 
Nevertheless,   on  the  basis  of  these  cases  one  might  conclude  that: 

•  FWL's  participation  in  dissemination  and  utilization  was  a 
significant  factor  in  Minicourse  adoption,  perhaps  even  more 
than  Macmillan' s  promotional  activities.     FWL  staff  possessed 
an  interest  and  a  level  of  expertise  that  made  their  contacts 
with  the  field  particularly  important. 

•  Clearly^   adoption  and  use  of  Minicourses  depended  on  the  ad- 
vocacy of  at  least  one  agent  at  the  local  level.     This  was 
most  clear  in  the  Chicago  case  where,  without  the  determined 
activities  of  a  district  superintendent,   the  Minicourses 
would  probably  not  have  been  adopted. 

•  Funding  potential  is  a  critical  aspect  of  any  adoption;  this 
was  particularly  true  for  the  Minicourse,  an  expensive  in- 
novation. 

•  The  active  establishment  of  incentives  encouraged  use.  Such 
incentives  included  units  toward  salary  increases,  release 
time,   course  credit  toward  degree,  pressure  from  administra- 
tors, or  the  support  of  group  processes.     The  Minicourse 
probably  received  little  use  in  districts  in  which  it  was 
simply  advertised  for  use  on  an  individual  basis  and  with 
no  particular  incentive. 
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IV  RECOMMENDATIONS 


A  variety  of  issues  would  be  interesting  and  informative  to  study 
further  or  to  monitor,   so  as  to  provide  data  for  other  uses.     These  in- 
clude: 

•  Complexity  of  the  product  with  respect  to  -potential  prob- 
lems of  distribution  and  installation/use • 

•  Availability  of  funds  for  purchasing  an  innovation.  Can 
it  be  purchased  within  existing  LEA  budget  guidelines? 

•  Extent  to  which  there  is  ample  feedback  from  the  field  in 
all  phases  of  product  development  and  utilization.  In 
particular,   this  may  entail  closer  working  arrangements 
with  commercial  sales  forces  to  provide  information  on 
needed  products,   likelihood  of  use,  and  so  on. 

•  Size  and  parameters  of  market  for  a  new  product  or  pro- 
gram. 

•  Time  lag  from  development  to  dissemination  to  use.  Pro- 
grams should  not  be  cut  off  before  adequate  time  has  been 
given  for  proper  dissemination  and  utilization  efforts. 

•  Various  linking  agencies  that  could  serve  as  dissemination/ 
distribution/ installation  outlets. 

•  Key  constituencies  likely  to  support  or  to  oppose  a  par- 
ticular innovation- -such  as  teacher  unions,  minority  par- 
ents,  and  the  like. 

•  The  degree  to  which  the  copyright  officer  at  NIE  and  other 
similar  agencies  sponsoring  develbpment  work  are  willing 
to  use  a  high  degree  of  discretion  in  their  interpretation 
of  the  copyright  guidelines,   so  as  to  maximize  the  likeli- 
hood of  effective  dissemination. 

Insofar  as  actual  recommendations,  however,  we  have  but  two.  First, 
we  recommend  that  NIE  find  some  way  to  monitor  the  numbers  and  types  of 
agents  at  the  local  and  regional  levels  that  are  authorized  or  given  re- 
sources to  seek  out,   try  out,  and  recommend  new  curricular  innovations-- 
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both  for  in-service  training  and  for  use  in  classrooms.     The  findings  of 
this  case  study  indicate  that  this  information  would  be  a  most  valuable 
addition  to  the  DATABOOK  monitoring  effort,  because  of  the  degree  to  which 
this  agent  is  a  necessary  precondition  to  highly  effective  dissemination/ 
utilization. 

Second,  we  recommend  that  a  comparative  cost/benefit  policy  analysis 
be  done  regarding  various  modes  of  dissemination  that  have  been  tried  or 
that  are  envisioned  by  NIE.     For  instance,  in  this  case  study  we  learned 
that  the  National  Center  for  Educational  Communications  (NCEC),  which  for 
several  years  existed  within  the  U.S.  Office  of  Education,   sponsored  a 
series  of  demonstration  centers  that  are  reputed  to  have  been  quite  cost- 
effective  (they  accounted  for  large  increases  in  Minicourse  in  the  geo- 
graphical areas  surrounding  the  centers),  but  were  discontinued  without 
any  real  assessment  of  their  worth.     At  minimum,   it  would  seem  to  NIE's 
advantage  to  obtain  some, written  description  of  the  demonstration  center 
experiment  and  its  apparent  results  for  u~se  in  future  dissemination  plan- 
ning activities. 
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IN  THE  STUDY  OF  MINICOURSES 
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I  INTRODUCTION 

A  major  program  of  educational  reform  began  in  the  late  1950s  under 
the  auspices  of  the  National  Science  Foundation  (NSF).     The  NSF  Course 
Content  Improvement  Project  was  an  attempt  to  effect  educational  change 
through  curriculum  reform,  primarily  in  the  sciences.     One  of  these 
curriculum  development  efforts  came  in  the  field  of  mathematics  education 
through  a  project  known  as  the  School  Mathematics  Study  Group  (SMSG), 
which  existed  from  1958  to  1972.     The  SMSG  math  project  is  the  topic  of 
this  study  for  two  reasons:     it  was  a  significant,   large-scale  attempt  at 
educational  change  using  a  widely  recognized  strategy  (curriculum  reform), 
and  it  represents  an  interesting  contrast  with  the  Minicourse  case  (see 
Topic  V),   allowing  substantive  comparisons  between  these  two  development 
efforts. 

In  the  case  of  Minicourse  development,  our  analysis  aims  at  the  com- 
plex interaction  of  policies,  agents,  activities)  and  resources  through 
time  and  across  levels  of  scope.     Here,  we  adopt  the  analytic  framework 
Jor  a  different  purpose,   limiting  the  analysis  to  identification  of  all 
significant  policies  bearing  on  SMSG  activities.     The  question  generating 
this  inquiry  is  simply,  '*What  policies  bear  on  a  given  activity?"  (in  this 
case  the  development  of  SMSG  math).     The  focus  of  this  case  study,  then, 
is  the  identification,  not  the  assessment  of  policies.     However,  our  in- 
tent in  pursuing  this  purpose  will  be  two-fold:    We  may  compare  this  use 
of  the  analytic  framework  with  its  use  in  the  more  complex  analysis  of 
Minicourse  development,   and  we  shall  provide  an  assessment  of  this  approach 
through  comparison  with  a  fuller  treatment  of  SMSG  in  Annex  A,  appended 
to  this  case  study. 
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11    POLICIES  BEARING  ON  SMSG 


We  may  depict  the  policies  bearing  on  SMSG  by  a  series  of  policy 
maps,  each  covering  a  different  aspect  of  this  activity;     Figure  VI-1 
represents  the  establishment  and  organization  of  SMSG,     Following  two 
NSF-sponsored  conferences  on  mathematics  in  1958,   the  American  Mathematical 
Society  (AMS),  the  Mathematics  Association  of  America  (MAA),  and  the 
National  Council  of  Teachers  of  Mathematics  (NCTM)  appointed  a  committee 
to  make  recommendations  concerning  the  development  of  a  new  math  curricula. 
This  committee  returned  recommendations  that  essentially  established  the 
School  Mathematics  Study  Group.     These  recommendations  called  for  a  direc- 
tor, advisory  board,   and  supervisory  panels  to  oversee  the  work.  The 
organization  of  SMSG  and  provision' for  appointments  to  the  advisory  panel 
were  formally  established  in  the  bylaws  passed  in  1961, 

Following  the  resolution  to  establish  SMSG,  Dr,  E,  Begle  was  appointed 
director,   and  a  proposal  was  submitted  to  NSF.     By  May  of  1958,  NSF  had 


Three- Member 
Recommendation 
Committee 


Bylaws 


Establishment  of  SMSG; 
Appointment  of  Board  Members 
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provided  the  first  grant  of  $100,000^   and  over  the  next  14  years^  a 
series  of  NSF  grants  supported  SMSG  activities.     Consequently^  the  pro- 
posals that  Dr.  Begle  wrote  and  the  grants  awarded  in  response  to  these 
proposals  were  key  policy  regulators.     According  to  Dr.  Begle,   the  NSF 
generally  supported  the  requests  submitted,  but  occasionally  vetoed  a 
project  or  made  an  additional  request  for  a  report  or  some  other  project. 
Unfortunately,   the  destruction  of  the  NSF  proposals  and  grants  in  a  fire 
at  Stanford  University  prevents  a  more  detailed  discussion  of  these 
transactions  and  prevents,  as  well,  a  determination  of  the  specific  regu- 
lations that  affected  SMSG  activities. 

Within  SMSG,  the  advisory  board  was  the  chief  source  of  policy,  and 
all  formal  policy  in  SMSG  emanated  from  this  source.     Most  particularly, 
the  board  determined  what  projects  SMSG  would  pursue,  subject  to  acceptance 
by  NSF.    Figure  VI- 2  depicts  the  generic  policymaking  sequence.     In  prac- 
tice,  the  director  had  a  large  measure  of  influence  over  this  process,  as 
he  sat  on  the  board,  was  responsible  for  appointing  members  of  supervisory 
panels  and  work  groups,  and  sat  in  on  most  supervisory  panel  meetings. 
Generally  the  decision  to  pursue  a  new  project  of  interest  came  directly 
from  the  recommendations  and  resolutions  of  the  board.     Occasionally,  the 
board  requested  that  a  conference  be  held  and  recommendations  submitted. 
This  input  then  became  one  basis  for  the  board's  decision.    Following  a 
board  recommendation,   the  director  appointed  a  supervisory  panel  to  draw 
up  the  outline  for  the  proposed  curriculum.     Finally,  a  work  group  wrote 
the  text  during  an  intensive  session  of  several  months  during  the  summer. 
In  this  manner  SMSG  produced  a  complete  set  of  math  texts,  K-12,  teacher 
editions  for  each  student  text,   and  a  number  of  supplementary  texts  and 
materials  such  as  the  New  Math  Library,  a  monograph  series,  and  a  group 
of  teacher  training  films.     In  several  cases,   the  board  recommended  that 
more  than  one  text  be  produced:     the  7th,  8th,  and  9th  grade  texts  were 
revised  and  rewritten  for  below- average  students,  and  SMSG  initiated  a 
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Curriculum  Development 
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Draw  up  work  outii 
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Work 
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Develop 
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FIGURE  VI-2    SMSG  POLICYMAKING  SEQUENCE 

second  round  of  curriculum  development  in  1968,  producing  an  entirely 
new  set  of  texts,  7- 12,     Table  VI- 1  shows  the  major  materials  developed 
by  SMSG. 

In  addition  to  NSF,  the  SMSG  advisory  board,   and  the  SMSG  director, 
a  fourth  source  of  policy  was  the  subcontracts  between  SMSG  and  other 
agents  covering  evaluation  and  research  activities.     SMSG  became  engaged 
not  only  in  evaluating  their  texts,  but  also  in  a  number  of  basic  and 
applied  research  studies  of  mathematical  abilities.     Two  agents.  Educa- 
tional Testing  Service  (ETS)  and  the  Minnesota  National  Laboratory  for  the 
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Improvement  of  Secondary  Mathematics,  carried  out  portions  of  this  re- 
search.    The  work  of  the  Minnesota  Math  Lab  was  generally  included  as 
part  of  the  NSF  grants,  while  subcontracting  arrangements  with  ETS  were 
the  rule.     Figure  VI- 3  depicts  this  policy  source. 


SMSG 
Subcontracts 


FIGURE  VI-3    SUBCONTRACTING  ARRANGEMENTS  FOR  SMSG  CURRICULUM 
EVALUATION 

Table  VI- 2  shows  the  major  studies  carried  out  by  SMSG.     Four  sets 
of  policies  regulated  these  evaluation  and  research  activities:     an  ad- 
visory board  recommendation  that  the  study  be  made,  provision  for  the 
study  and  its  budget  ii^an  NSF  grant,  guidelines  and  outline  of  research 
established  by  the  relevant  supervisory  panel,   and  in  some  cases  a  sub- 
contract with  ETS  or  arrangement  with  the  Minnesota  Math  Lab. 

Policies  regulating  the  production  and  distribution  of  SMSG  materials 
came  in  the  form  of  contracts  and  copyrights.     SMSG  secured  copyrights 
for  all  their  products  and  used  several  publishers  for  their  materials. 
Initially,  Yale  University  Press  distributed  SMSG  texts  (Dr.  Begle  was  a 
member  of  the  Yale  University  faculty  until  1961,  when  he  and  the  SMSG 
operation  moved  to  Stanford  University).     Later,  A.  C.  Vroman  Co.  became 
the  chief  distributor,  with  other  firms  assuming  minor  roles.  Random 
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House  and  later  A,  C,  Singer  proauced  the  New  Math  Library,  Modern 
Learning  Aids  produced  the  teacher- training  films,  and  Houghton-Mifflin 
produced  some  of  the  research  reports.     Figure  VI-4  depicts  these  policy 
sources.     The  contracts  were  of  a  standai^d  form  specifying  prices,  royal- 
ties, commission  on  sales,   storage  of  texts,  Stanford  University  approval 
of  all  advertising  copy,   and  so  on,  -The  contracts  were  formally  nego- 
tiated between  Stanford  University  and  the  commercial  publisher,   as  SMSG 
received  sponsorship  from  that  university  through  Dr,  Begle's  position 
as  a  faculty  member. 
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FIGURE  VM    POLICY  SOURCES  THAT  DETERMINED  THE  CONTRACT  PROVISIONS 
BETWEEN  SMSG  RESEARCHERS  AND  PUBLISHERS/DISTRIBUTORS 


Finally,   SMSG  worked  out  formal  policy  to  meet  two  related  problems: 
first,   the  issue  of  when  to  withdraw  SMSG  texts  from  the  market  and, 
second,   the  need  for  policy  on  use  of  SMSG  materials  in  commercially 
produced  texts.     Initially  the  advisory  board  issued  a  statement  that 
texts  would  be  available  for  five  years;  a  year  later  the  period  was 
changed  to  "as  long  as  was  needed,"    To  determine  this  "need,"  the  board 
experimented  with  three  strategies:     checklists  with  which  to  review 
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commercial  texts,  multiple  reviews  of  new  commercial  texts,  and  drop  in 
demand  for  SMSG  texts.     The  point  was  to  determine  when  commercial  pub- 
lishers were  producing  a  sufficiently  good  math  text  by  SMSG  standards 
to  warrant  withdrawal  of  SMSG  texts.     Part  of  this  problem  concerned  the 
use  of  SMSG  materials.    Many  mathematicians  who  produced  commercial  texts 
had  also  worked  on  SMSG  texts,  which  created  certain  equity  problems  that 
the  board  resolved  through  the  following  policy: 

•  Permission  to  use  SMSG  materials  could  be  secured  from  the 
director  of  SMSG. 

•  In  determining  such  use,  no  account  was  to  be  taken  of  an 
author's  connections  with  SMSG. 

•  In  no  case  was  permission  given  to  use  SMSG  materials  until 
the  publication  had  been  available  for  two  years. 

The  board,   in  response  to  a  requirement  from  NSF,   first  ruled  that  no 
royalty  payments  would  be  allowed  to  authors  of  texts  using  SMSG  materials. 
When  this  policy  proved  too  restrictive,   they  determined  that  a  percentage 
of  the  royalties  would  be  returned  to  NSF.     Finally,  with  approval  from 
NSF,  the  board  ruled  that  all  royalties  would  go  directly  to  the  author. 
These  related  policies  are  depicted  in  Figure  VI-5. 

We  may  summari?;e  this  policy-oriented  analysis  of  SMSG  in  two  ways. 
Figure  VI-6  draws  together  major  policies  linking  the  setting  and  com- 
plying agents.     Table  VI-3  provides  this  policy  breakout  in  a  different 
form  and  with  the  inclusion  of  activities  and  resources. 
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FIGURE  VI-5    CONTRAST  OF  INITIAL  AND  SUBSEQUENT  SMSG  POLICY  BOARD 
DECISIONS  CONCERNING  ROYALTIES 
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FIGURE  VI-6    GENERIC  POLICY  STRUCTURE  OF  SMSG 
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Ill    USE  OF  THE  ANALYTIC  FRAMEWORK 


A  number  of  sources  provided  the  information  for  this  case  study^ 
the  foremost  being  Dr.  Begle^  director  of  SMSG  during  its  14-year  tenure^ 
who  granted  a  number  of  interviews.     Other  primary  sources  included  SMSG 
newsletters^  minutes  of  the  advisory  board^  various  SMSG  reports  and  docu- 
ments^ miscellaneous  correspondence  from  the  SMSG  files^  and  the  contracts 
with  various  commercial  publishers.     Secondary  sources  are  listed  in  the 
reference  list  that  follows  this  case  study. 

In  the  process  of  consulting  our  various  sources  to  locate  signifi- 
cant policies^  we  collected  more  data  on  SMSG  than  are  reported  above. 
Compared  with  the  treatment  accorded  SMSG  in  Annex  A^   the  simple  analysis 
seems  sparse  indeed.     Two  observations  are  noteworthy.     The  first  is  that 
the  conduct  of  SMSG  was  notable  for  its  relative  lack  of  fomal  policy. 
Many  of  the  critical  decisions  were  not  recorded^  much  less  codified. 
More  often  than  not^  decisions  internal  to  SMSG  were  made  and  transmitted 
infomally.     A  number  of  standard  operating  procedures  were  simply  never 
articulated  as  policy.     Given  the  character  of  this  enterprise^   then^  the 
simple  identification  of  policy  provides  a  meager  account  of  this  activity. 
However^   a  simple  analysis  of  an  activity  more  fully  defined  and  mediated 
by  formal  policy  might  prove  more  illuminating. 

The  second  observation  serves  to  sharpen  the  distinction  between  a 
simple  and  a  complex  analysis.     The  difference  lies  not  in  the  amount  of 
data  which  an  analyst  must  process^  but  in  the  manner  in  which  he  organizes 
the  data  and  reconstructs  the  case.     A  simple  analysis  requires  only  the 
location  and  articulation  of  relations  among  policies^   agents^   and  ac- 
tivities.    Complex  analysis  entails  representing  interactions  among  agents^ 
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policies,  and  activities  at  different  points  in  time  and,  frequently, 
using  more  than  one  "field-focus"  scope  of  analysis.    Complex  analysis 
may  also  entail  an  assessment  of  the  impact  of  policy  that  moves  far  be- 
yond that  which  a  simple  analysis  purports  to  do.     The  point,   though,  is 
that  the  investment  of  time  in  data  collection  may  be  negligibly  different 
using  either  mode  of  analysis.     In  the  process  of  identifying  policies, 
one  inevitably  learns  more  about  an  EKPU  activity  than  an  account  of 
policies  alone  reveals. 

A  number  of  qualifications  to  these  suggestions  lead  to  further  ob- 
servations.    This  case  study  used  as  a  reporting  device  the  concept  of 
"generic  policy."    This  term  indicates  a  policy  whose  structure  and  func- 
tion remain  stable  but  which  is  manifest  in  any  number  of  specific  in- 
stances,  and  whose  contents  may  have  altered.    The  prime  example  in  this 
case  is  the  NSF-SMSG  grants.     The  function  of  these  grants  was  to  regulate 
the  exchange  of  funds  for  projects  and  products  of  a  specified  nature. 
The  provisions  structuring  these  grants  did  not  vary,  but  the  particular 
amount  of  funding  and  the  specified  projects  and  products -did  change  with 
each  new  grant.    Using  the  concept  of  generic  policy  raises  two  issues. 
First,  faced  with  a  repetitive  policy  such  as  the  NSF  grants,   it  seemed 
sensible  to  create  a  shorthand  means  of  representing  such  policy--the 
concept  of  generic  policy  provides  such  a  means.     The  increase  in  infor- 
mation about  SMSG  promised  by  a  complete  enumeration  of  the  grants  seemed 
incommensurate  with  the  added  expenditure  of  time  and  effort.     This  is, 
then,  one  instance  of  judgment  concerning  a  trade-off  that  use  of  the 
analytic  framework  entails.     Second,  use  of  this  shorthand  option  leaves 
open  the  possibility  that  a  complete  enumeration  of  all  grants,  contracts, 
board  resolutions,   and  the  like  would  have  provided  the  complete  picture 
of  SMSG  that  we  have  claimed  is  not  available  through  a  simple  analysis. 
There  is  some  merit  in  this  point  of  view,  but  a  reading  of  Annex  A  re- 
veals aspects  of  SMSG  (such  as  the  use  of  tryout  centers  to  gain  teacher 
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feedback  on  new  texts)  not  covered  by  any  specific  policies.    To  reiterate 
use  of  the  analytic  framework  entails  a  judgment  that  weighs  level  of  de- 
tail in  data  collection  against  the  time  expended  to  achieve  such  detail. 
The  principal  guide  to  making  this  judgment  vlll  be  the  purposes  of  the 
analysis  conditioned  by  the  practical  constraints  facing  the  analyst. 
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Annex  A 

BACKGROUND  ANALYSIS  OF  SMSG  MATH 

Introduction 

This  account  of  SMSG  activities  attempts  a  thorough  portrayal  of 
this  project  and  essays  some  conclusions  about  SMSG  as  compared  with  the 
Minicourse  case.    There  is  little  attempt  to  structure  the  material  using 
the  analytic  framework.     The  purpose  is  to  provide  baseline  information 
for  comparison  with  the  simple  analysis  of  SMSG  and  with  the  Minicourse 
case  study.     The  analysis  is  presented  in  four  sections:     (1)  a  brief 
overview  emphasizing  certain  features  of  the  context  within  which  SMSG 
was  created  and  carried  out,   (2)  the  organization  and  operation  of  SMSG, 
(3)  significant  changes  in  SMSG  goals,  activities,   and  the  like,  and  (4) 
a  compare/contrast  perspective  with  Topic  V,  the  Minicourse  case  study, 
and  some  conclusions. 

Overview 

A  confluence  of  factors  resulted  in  the  establishment  of  SMSG  in 
1958.    Within  the  professional  math  community  there  had  been  a  growing 
sense  of  the  discrepancy  between  advances  in  the  basic  structure  and 
conception  of  mathematics,   and  a  precollege  math  curriculum  that  did  not 
reflect  these  historic  and  revolutionary  changes.  Before^SMSG, — some  re- 
vision of  math  curricula  occurred  under  Dr.  Max  Beberman  at  the  University 
of  Illinois,   and  through  the  initiative  of  the  College  Entrance  Examina- 
tion Board.     The  catalyst  to  curriculum  reform,  however,  was  the  launching 
of  Sputnik  in  1956.     The  perception  that  the  United  States  was  behind  its 
chief  rival  in  scientific  accomplishments  (at  least  in  the  area  of  space 
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travel)  set  off  a  demand  for  improved  identification  and  education  of 
scientific  talent.     One  concrete  response  to  this  demand  was  the  NSF 
Course  Content  Improvement  Project^  which  first  funded  the  Physical 
Sciences  Study  Connnittee  (PSSC),  followed  by  SMSG  and  other  major  curricu- 
lum projects  in  the  sciences. 

The  genesis  of  SMSG  was  an  NSF- sponsored  meeting  of  mathematicians 
held  at  MIT  in  February  1958.     Participants  at  this  meeting  included 
Dr.  Jerrold  Zacharias^  head  of  PSSC.     Following  the  lead  of  the  physics 
group^  the  meeting  recommended  that  the  American  Mathematical  Society 
appoint  a  committee  to  initiate  a  curriculum  development  project.  The 
AMS  complied,   and  Dr.  E.  G.  Begle  was  offered  leadership  of  the  project, 
with  Yale  University  providing  the  institutional  setting.    NSF  gave  an 
initial  grant  of  $100, 000,  and  the  project  was  under  way  by  the  summer 
of  1958. 

Over  the  next  14  years  SMSG  developed  a  large  number  of  math  materials. 
The  principal  goal  became  production  of  textbooks — K- 12- -with  several 
versions  produced  for  various  levels  of  student  ability.  _SMSG  also 
carried  out  the  field  testing  and  revision  of  their  texts  and  initiated 
a  number  of  research  and  evaluation  studies  in  math  education  [the  most 
notable  being  the  National  Longitudinal  Study  of  Mathematical  Abilities 
(NLSMA)  from  1962  to  1967].    The  impact  of  SMSG  has  been  notable:  Over 
five  million  students  have  used  SMSG  materials;  subsequent  commercial  text- 
books have  been  heavily  influenced  by  the  SMSG  approach,   in  part  because 
many  textbook  writers  worked  at  some  time  on  SMSG  materials;  and  SMSG  as 
an  enterprise  contributed  to  the  knowledge  and  practice  of  curriculum  de- 
velopment. 

Organization  and  Operation  of  SMSG 

Although  there  have  been  changes  in  the  goals,  procedures,   and  or- 
ganization of  SMSG,  there  has  also  been  a  remarkable  fidelity  to  the  basic 
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approach  that  initially  guided  development.     The  committee  appointed  by 
the  AMS  recommended  a  simple  organization  that  included  the  director^  an 
advisory  committee^  and  an  executive  committee  composed  of  advisory  com- 
mittee members.     The  initial  charge  to  the  group  was  general  (i.e,^ 
improve  the  general  level  of  instruction  in  mathematics  in  elementary  and 
secondary  schools"),  and  there  was  no  decision  on  the  duration  of  SMSG  as  . 
an  entity.     Consequently^  the  history  of  SMSG  is  best  viewed  as  an  organic 
development  rather  than  as  a  ''blueprint"  development.     The  process  of 
institutionalization  (the  little  that  occurred)  proceeded  slowly.     It  was 
not  until  1961  that  bylaws  were  passed^  establishing  policies  such  as 
tenure  of  advisory  board  members^  method  for  replacing  outgoing  board 
members^   and  power  to  appoint  ad  hoc  and  other  committees.     The  director^ 
chief  policy- setting  actor  within  SMSG^  had  wide  discretionary  authority 
limited  only  by  the  bylaws  and  by  contractual  obligations  to  NSF.  In 
practice^   of  course^   the  director  worked  closely  with  the  advisory  board 
and  corresponded  often  with  NSF.     The  director's  authority^  however^  can- 
not be  overstated.     He  was  constantly  in  touch  with  the  daily  operation 
of  SMSG;  he  appointed  the  members  of  the  supervisory  panels  and  working 
groups  (to  be  discussed  below)  and  sat  in  on  their  meetings;  along  with 
other  board  members,  he  could  place  items  on  the  board  agenda;  and  he  pre- 
pared and  submitted  all  proposals  for  grants  to  NSF  and  sent  in  monthly 
progress  reports.     Consequently,  SMSG  policy  setting  was  predominantly 
but  not  exclusively  controlled  by  a  single  actor,  the  director. 

For  each  project  undertaken  by  SMSG,  a  supervisory  panel  was  appointed 
to  outline  and  oversee  the  work.     The  panels  were  essentially  independent, 
however,   and  varied  in  their  operation.     The  Panel  on  Sample  Texts  was 
concerned  only  with  general  matters  such  as  keeping  conmunications  open 
between  writing  teams  and  establishing  the  format  of  textbooks.     On  the 
other  hand,   the  Junior  High  Panel  actively  engaged  in  planning  and  writing 
of  text  materials.    Completing  the  organizational  hierarchy  were  the 
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writing  teams  who  generally  worked  from  an  outline  prepared  by  a  super- 
visory panels  but  were  then  free  to  write  as  they  wished. 

The  production  of  SMSG  materials  may  be  divided  into  two  sequences. 
First  was  the  process  through  which  a  topic  or  project  was  proposed,  con- 
sidered, and  then  accepted  or  rejected;  this  we  term  the  generative  se- 
quence.   Next  was  the  process  by  which  a  product  was  created,  tested, 
revised,   and  released;  this  we  term  the  developmental  sequence.     In  both 
cases  a  stable  series  of  steps  was  usually  followed,  but  as  a  matter  of 
practice  the  steps  were  never  formally  codified  as  policy. 

*       The  generative  sequence  followed  this  pattern: 

•  A  suggestion  for  a  new  project  or  product  was  introduced  at 
the  advisory  board  meeting.     Sources  for  such  suggestions 
varied  from  members  of  the  board,   to  the  director,   to  out- 
side requests. 

•  After  deliberation,  the  board  appointed  an  ad  hoc  committee 
or  convened  a  conference  to  study  the  issue  and  to  report 
back  with  recommendations. 

•  Upon  accepting  a  recommendation,  the  director  in  consultation 
with  the  board  appointed  a  supervisory  panel  to  outline  the 
work.     A  working  group  was  appointed,  and  the  developmental  , 
sequence  was  set  in  motion. 

The  developmental  -sequence  included  the  following  steps; 

•  The  supervisory  panel  drew  up  an  outline  of  the  work. 

•  Convening  during  the  summer,   a  work  group  of  research 
mathematicians  and  teachers  wrote  a  first  draft. 

•  The  first  draft  became  the  preliminary  version  of  the  text 
that  was  printed  and  distributed  to  tryout  centers  around 
the  country.     Cooperating  teachers  used  the  text  duri.ng  that 
school  year  and  submitted  a  written  evaluation  to  SMSG. 

•  The  supervisory  panel  or  work  group  used  the  input  from  the 
field  to  revise  the  text  during  the  following  summer. 
Generally,  this  revision  resulted  in  a  final  draft  printed 
for  general  use.    However,   in  some  instances  further  revision 
was  necessary. 
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SMSG  also  developed  procedures  to  deal  with  the  problems  of  distribu- 
tion and  adoption.     Initially^  Yale  University  Press  acted  as  distributor 
for  SMSG  materials.     Later^  a  number  of  commercial  firms  distributed 
various  SMSG  products^  e.g.^  A.  C.  Vroman  Co.^  Random  House^  and  Modern 
Learning  * Aids.     The  policy  of  interest  in  this  area  concerned  SMSG's 
stance  on  the  publicity  and  sales  of  their  materials.     From  its  inception^ 
SMSG  intended  to  produce  materials  that  would  (1)  exemplify  the  kind  of 
mathematics  the  group  advocated^   (2)  serve  as  stimuli^  models^  and  sources 
for  authors  of  commercial  publications^   and  (3)  provide  interim  materials 
until  suitable  commercial  books  became  available.     This  policy  resulted 
in  a  number  of  practical  problems  (discussed  in  more  detail  below)  and  a 
dilemma  with  respect  to  dissemination;  i.e.^  the  group  wished  to  maximize 
their  impact  on  the  field  of  precollege  math^  but  were  philosophically 
opposed  to  active  promotion  of  their  materials  (a  position  that  NSF  en- 
couraged as  in  keeping  with  the  decentralized^  autonomous  nature  of  the 
U.S.  school  system).     The  result  was  the  production  of  plain^  soft-cover 
texts  unsuitable  for  long-term  adoption^  and  a  minimal  promotional  effort 
that  included  publication  of  a  newsletter^  occasional  displays  at  confer- 
ences^ and  the  natural  interest  generated  by  the  development  and  field- 
testing  work  that  included  many  teachers  around  the  country. 

To  meet  the  problem  of  adoption  and  use^  SMSG  adopted  several  proce- 
dures.    First  was  the  decision  to  create  texts  a  unit  at  a  time  rather 
than  to  develop  an  entire  K-12  program  based  on  careful  sequencing  and 
integration.     The  assumption  was  that  school  districts  could  more  easily 
adopt  individual  texts  that  did  not  violate  accepted  grade  placement  of 
topics.    More  particularly^  though^  explicit  steps  were  taken  to  inform 
teachers  about  the  approach  embodied  in  SMSG  materials.     Before  each 
school  year^  SMSG  held  an  orientation  conference . for  teachers  who  would^J 
be  using  SMSG  materials  that  year.     Then  each  tryout  center  was  staffed  - 
with  a  research  mathematician  who  consulted  with  the  classroom  teachers 
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throughout  the  tryout  year.     These  active  in-service  activities  were 
necessary  for  helping  teachers  to  make  the  transition  from  traditional 
practices  to  the  '*new  math." 

A  final  general  feature  of  SMSG  concerned  arrangements  for  testing 
and  evaluation.     Although  SMSG  carried  out  certain  studies  themselves^ 
they  subcontracted  some  evaluation  work  to  outside  agents.     At  the  NSF 
conference  in  1958^  which  recommended  a  math  curriculum  effort^  another 
resolution  was  passed  "welcoming  action  by  the  State  of  Minnesota  to 
provide  facilities  for  statewide  testing  of  the  materials  to  be  produced 
by  SMSG,"    Consequently^  at  the  same  time  SMSG  started  up^  legislation 
in  Minnesota  established  the  Minnesota  National  Laboratory  for  the  Im- 
provement of  Secondary  Mathematics,     This  group^  under  the  direction  of 
Dr,  P.  C,  Rosenbloom  carried  out  several  evaluations  and  conducted  much 
of  the  basic  SMSG  research.     The  other  evaluation  agent  was  ETS^  which 
conducted  an  early  study  using  student  outcomes  in  1960,    For  nearly  a 
decade  and  a  half,   SMSG  mounted  significant  research  studies  in  mathe- 
matics learning,   and  Stanford  University  still  has  a  large  amount  of  data 
available  for  secondary  analyses. 

Changes  in  SMSG,  1958-72 

Several  major  shifts  occurred  during  the  history  of  SMSG,  more  often 
in  response  to  a  shifting  social  climate  than  in  response  to  specific 
directives  from  NSF,     These  changes,  discussed  below,  were  for  the  most 
part  gradual  shifts  in  emphasis  and  priority  rather  than  drastic  breaks. 

First,   the  initial  emphasis  of  SMSG  was^on  training  average  and  above 
average  students  as  potential  scientists.    However,  as  the  post-Sputnik 
concern  gave  way  in  the  1960s  to  increasing  emphasis  on  social  welfare, 
equalizing  opportunity,  and  the  like,   SMSG  targeted  more  of  their  research 
and  development  to  the  "slow"  student,   to  the  "culturally  disadvantaged," 
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and  to  the  problems  of  math  teaching  in  urban  slums.     This  was  a  shift 
not  in  basic  goals  so  much  as  a  shift  in  the  target  of  effort  that  coin- 
cided roughly  with  shifts  in  national  priorities  and  concerns.    We  judge 
that  the  impetus  for  this  change  came  not  through  official  channels  (i.e.^ 
NSF),  but  rather  through  the  perceptions  of  SMSG  agents  sensitive  to  pre- 
vailing national  concerns. 

Second,  the  focus  of  SMSG  activity  changed,  as  evidenced  most  clearly 
by  contrasting  the  initial  statement  of  purpose  with  the  subsequent  state- 
ment cf  purpose;  these  statements  are  quoted  below  from  the  SMSG  bylaws: 

...  we  need  an  improved  curriculum  which  will  offer  students 
not  only  the  basic  math  skills  but  also  a  deeper  undezstatiding 
of  the  basic  concepts  and  structure  of  mathematics.     ...  [Next], 
math  programs  must  attract  and  train  more  of  those  students  who 
are  capable  of  studying  mathematics  with  profit.     Finally,  all 
help  possible  must  be  provided  for  teachers  who  are  preparing 
themselves  to  teach  these  challenging  and  interesting  courses 
(March  1959). 

The  primary  purpose  of  the  SMSG  is  to  foster  research  and  de- 
velopment in  the  teaching  of  school  mathematics  (March  1962). 

The  1962  statement  goes  on  to  place  major  emphasis  on  development  of 
materials,  but,  in  fact,   there  was  a  growing  emphasis  on  research  and 
evaluation.     The  initial  goal  of  SMSG  was  to  create  materials  and  to 
educate  teachers  in  their  use.     As  SMSG  progressed,  however,  increasing 
attention  went  to  basic  research.     What  dictated  the  initial  curriculum 
reform  were  changes  in  the  logic  of  the  discipline  of  mathematics.  What 
came  to  be  a  concern  was  the  psychology  of  learning  mathematics — leading 
to  NLSMA,  ELMA,   and  the  other  research  studies  conducted  later.     In  this 
sense,   it  is  not  inaccurate  to  claim  that  development  and  dissemination 
preceded  research  in  the  case  of  SMSG.     Again,   the  stimulus  for  this 
shift  in  emphasis  came  from  perceptions  of  key  actors  in  SMSG  who  were 
strongly  influenced  during  the  1960s  by  the  work  of  psychologists  such  as 
Jean  Piaget,   and  by  a  book  drawing  on  Piaget's  work,  Jerome  Bruner's 
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The  Process  of  Education  (1965).     An  increased  concern  for  the  develop- 
mental and  psychological  bases  of  curriculum  resulted,  which  led  to  more 
research  and  testing. 

A  third  change  could  be  aptly  termed  one  of  strategy.     After  con- 
siderable deliberation,  SMSG  decided  to  initiate  a  second  round  of  cur- 
riculum revision  in  196  7.     The  purpose  of  this  second  effort  was  to 
produce  a  well-sequenced  secondary  curriculum  that  would  integrate  mathe- 
matics in  Grades  7  through  12  and  break  down  existing  compartmentalization 
by  creating  new  grade  placements  and  introducing  new  topics.     This  effort 
finished  in  1972  and,  as  with  the  above  changes,  represented  a  decision 
internal  to  SMSG.     In  general,  SMSG  procedures  remained  relatively  stable 
while  changes "in  programs  and  goals  did  occur.     The  origin  of  these  broad 
policy  changes  was  the  SMSG  itself --i. e. ,   its  leadership  responding  to 
changing  conditions  and  perceived  needs.     While  NSF  did  institute  several 
procedural  changes  (e.g.,   salaries  were  dropped  in  1965,   some  projects 
were  vetoed,   and  directives  were  issued  on  textbook  royalties  and  use  of 
SMSG  materials),  SMSG  was  largely  free  to  pursue  its  own  course  and  to 
make  those  shifts  in  priority  that  it  felt  were  desirable. 

Key  Issues  and  Conclusions 

Important  decisions  made  early  in  SMSG  were  consistent  with  the  basic 
philosophy  of  the  group  and  represented  stances*  on  important  issues.  The 
following  were  successful  resolutions  of  important  issues; 

•    The  writing  groups  were  composed  equally  of  research  mathe- 
maticians and  classroom  teachers,   a  successful  union  of  two 
groups  that  had  formerly  been  out  of  touch.     SMSG  itself 
came  into  being  with  the  approval  of  the  American  Mathematical 
Society,  the  Mathematics  Association  of  America,  and  the 
National  Council  of  the  Teachers  of  Mathematics,  each  a  neces- 
sary constituent  of  the  project. 
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•  In  the  early  1960s^   there  was  an  educational  controversy  on 
the  issue  of  establishing  "national  curricula."    Critics  of 
federal  involvement  in  curriculum  development  complained 
that  such  involvement  represented  an  attempt  to  usurp  local 
control  of  schools.     Sensitive  to  this  issue^  SMSG  chose  to 
emphasize  their  materials  as  samples  only^  and  as  stimuli 
to  commercial  publishers.    For  this  reason^  they  produced 
only  paper-bound  editions  using  photo-offset  from  a  type- 
written manuscript.     This  policy  actually  headed  off  two 
objections.     Firsts   it  met  the  criticisms  of  the  opponents 
of  national  curricula.     SMSG  did  not  intend  to  establish  a 
curriculum  but  rather  wished  to  stimulate  a  reform  in  mathe- 
matics education.     Second,   it  calmed  the  ire  of  the  pub- 
lishing industry,  which  saw  the  curriculum  projects  and 
certain  texts  sponsored  by  NSF  receiving,  in  effect,  a 
government  imprimatur.     By  minimizing  promotional  activity, 
providing  liberal  policy  on  use  of  SMSG  materials  in  commer- 
cial texts,   and  encouraging  commercial  publishers  to  follow 
the  SMSG  lead,  SMSG  was  relatively  successful  in  alleviating 
publishers'  fears. 

•  By  and  large,  SMSG  was  successful  in  gaining  the  participa- 
tion of  constituencies  and  of  maintaining  a  communications 
network.     The  AMS,  MAA,  and  NCTM  were  represented  on  the 
advisory  board,  the  supervisory  panels,  and  work  groups. 
The  tryout  centers  stimulated  interest  in  SMSG,  and  the 
newsletters  kept  the  professional  field  informed.  Partici- 
pation of  these  key  groups  headed  off  conflict  and  ensured 
a  measure  of  consensus  in  each  of  the  final  products. 

On  the  other  hand,  parents  and  students  were  not  included  in  SMSG 
activities.     A  series  of  conferences  sponsored  by  NCTM  informed  adminis- 
trators about  SMSG,  but  the  philosophy  of  the  group  called  for  local  dis- 
tricts to  inform  parents  about  SMSG.     This  procedure  had  no  repercussions 
until  the  last  several  years,  when  criticisms  surfaced  of  the  new  math's 
adverse  effects  on  computational  skills. 

One  critical  issue,  however,  was  debated  throughout  the  course  of 
SMSG  without  resulting  in  a  completely  successful  policy.     The  problem 
concerned  SMSG  policies  on  textbook  withdrawal  and  on  use  of  SMSG  materials. 
SMSG  philosophy  called  for  an  indirect  approach  to  reform,  i.e.,   to  pro- 
vide texts  as  a  stimulus  to  the  field  and  withdraw  the  texts  as  soon  as 
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commercial  materials  of  equal  quality  were  available.    The  question  was 
how  to  determine  when  this  had  occurred.     SMSG  t^ied  several  policies: 
developing  checklists  to  evaluate  commercial  texts^  establishing  multiple 
reviews  of  new  texts^   and  finally  using  fall-off  in  demand  as  the  criterion 
for  withdrawal  of  the  text.     The  other  controversy  centered  on  use  of  SMSG 
materials.     As  authors  in  SMSG  began  to  publish  their  own  texts,  the  ques- 
tion arose  of  royalties  and  permission  to  use  SMSG  material.  Initially 
NSF  refused  to  allow  royalty  payments  to  authors  using  SMSG  materials  in 
their  own  texts,  but  when  it  became  apparent  that  commercial  text«  did 
not  meet  SMSG  standards,  NSF  relaxed  this  policy  to  provide  greater  in- 
centive to  model  new  texts  on  the  SMSG  materials. 

Comparison  of  SMSG  with  Minicourses 

The  SMSG  project  differs  from  Minicourse  development  (see  Case  Study 
V)  in  a  number  of  ways: 

•  Minicourses  were  based  squarely  on  research,  both  in  terms 

of  the  original  research  on  microte aching  and  on  the  research 
underlying  each  Minicourse  topic.     SMSG  was  based  on  changes  - 
in  the  structure  of  mathematics,   and  not  on  research  in  the 
teaching  and  learning  of  math.     Research  preceded  development 
in  one  case  and  followed  it  in  the  other. 

•  The  change  strategy  was  different  in  each  case.  Minicourses 
were  direct  attempts  to  change  teacher  behavior;  they  were 

a  teacher  training  product  claimed  to  be  exemplary  and  mar- 
keted in  competition  with  other  products.     Such  an  approach 
requires  careful  attention  to  dissemination  and  adoption. 
The  goal  of  SMSG,  however,  was  explicitly  not  to  disseminate 
an  exemplary  product,  but  rather  to  establish  a  model  for  the 
field  to  emulate.     Consequently^  SMSG  did^not  have  to  face 
the  problems  of  ensuring  a  profit^  marketing,  advertising, 
and  the  like.» 

•  The  organizational/institutional  context  for  each  innovation 
was  different.     SMSG  was  a  transient  organization  with  a 
single  mission  and  little  need  to  engage  in  the  process  of 
institution  building--i.e.,  developing  policies  and  proce- 
dures, hiring  staff,  attracting  long-term  political  support, 
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and  the  like.     Its  tenure  as  an  organization  was  limited, 
and  few  actors  had  a  personal  stake  in  maintaining  its 
existence  beyond  that  which  was  necessary  to  accomplish 
its  mission.     By  contrast,  Minicourse  developed  as  a 
fledgling  institution  interested  not  only  in  its  mission 
goals  and  programs  but  also  in  its  survival  as  an  entity. 
The  consequences  of  this  contextual  difference  are  manifold, 
but  especially  relevant  to  this  study's  purposes  is  that  the 
full  panoply  of  policies  generated  at  FWL  bore  on  the  de- 
velopment of  Minicourses,  whereas  SMSG  operated  in  a  setting 
that  was  relatively  policy-free. 

An  intangible  factor  operated  in  the  case  of  SMSG,  which 
might  best  be  termed  a  climate  for  reform.     The  1960s  evi- 
denced a  general  receptivity  to  curriculum  innovations,  a 
certain  optimism  that  educational  improvement  would  result 
from  curriculum  reform.     Minicourses  met  no  such  receptive 
climate.     Because  of  their  price  ($1500  for  software  and  an 
additional  $1500  for  the  requisite  hardware)  and  a  general 
diminution  in  interest  relative  to  the  product,  marketing 
Minicourses  was  a  gamble  by  Macmillan  Company.     In  general, 
we  conclude  that  in  addition  to  tangible,  manipulable  factors 
influencing  the  dissemination  and  adoption  of  innovation, 
there  are  other  background  variables,  such  as  the  climate  of 
belief  and  opinion,  that  have  a  strong  effect. 

SMSG  was  particularly  successful  in  establishing  communica- 
tion with  and  gaining  the  cooperation  of  significant  portions 
of  its  audience.     Teachers  and  university  mathematicians 
collaborated  on  the  materials;  members  of  professional 
organizations  related  to  math  periodically  received  SMSG 
newsletters;  a  large  number  of  centers  were  set  up  for  trial 
use  of  new  materials ;  orientation  sessions  helped  train 
teachers  at  the  beginning  of  each  school  year;  and  NCTM  ran 
a  series  of  conferences  to  explain  SMSG  to  administrators. 
These  efforts  stand  in  contrast  to  FWL's  tardy  realization 
that  they  too  must  be  concerned  not  only  with  development 
but  also  with  dissemination  and  use  (hence  the  establishment 
of  the  Utilization  Division  at  the  Laboratory,   and  the  Mini- 
course  demonstration  centers  project). 
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Annex  B 


TAXONOMY  OF  POLICIES  CONSIDERED  SIGNIFICANT  IN  THE  STUDY  OF  THE 
SCHOOL  MATHEMATICS  STUDY  GROUP 
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I  INTRODUCTION 


Title  III,  one  of  the  series  of  categorical  grant  programs  authorized 
by  the  Elementary  and  Secondary  Education  Act  (ESEA),   is  a  departure  from 
the  traditional  research- development- dissemination- adoption  (RDDA)  approach 
to  educational  knowledge  production  and  utilization  (EKPU).     Key  to^ this 
departure  is  the  involvement  of  at  least  three  levels  of  educational  gov- 
ernance (local,   state,   and  federal)  in  Title  Ill-^peration,     Through  this 
program,   for  example,   innovative  projects  may  be  initiated  by  the  practic- 
ing teacher  and  the  local  education  agency  (LEA)  administered  by  the  state, 
and  funded  by  federal  monies. 

Because  it  represents  a  departure  from  the  RDDA  approach  and  because 
three  levels  of  educational  governance  are  involved,  we  have  chosen  to 
apply  the  analytic  framework*  to  the  policy  interaction  Title  III  requires. 
Specifically,   this  analysis  shows  how  three  state  education  agencies  (SEAs) 
coordinate  their  activities  with  three  sets  of  formal  requirements.  These 
requirements  include  those  of  the  federal  Title  III  program  that  the  SEA 
must  meet  to  get  funded,   those  of  the  state  codes  under  which  the  SEA  falls 
by  virtue  of  its  role  in  state  government,   and  those  of  local  education 
agencies  with  which  SEA  programs  must  be  compatible  for  eash  adoption  or 
acceptance. 


This  study  is  not  concerned  with  Title  III  per  se.     The  topic  was  chosen 
for  use  in  a  feasibility  study  for  designing  an  analytic  framework  by 
which  NIE  might  improve  its  ability  to  monitor  the  condition  of  KPU  in 
American  education  (see  "A  Methodology  for  Describing  the  Infrastructure 
of  Educational  R&D,"  which  is  Volume  I  of  this  study).     In  particular, 
this  topic  was  exploited  as  a  test  for  the  key  concepts  of  that  analytic 
framework. 
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The  mechanism  whereby  these  three  sets  of  requirements  are  incorpo- 
rated into  the  operation  of  Title  III  is  the  state  Title  III  plan.  This 
plan  is  a  yearly  contract  between  the  state  and  USOE^   specifying  how  the 
state  will  meet  federal  requirements  while  staying  within  those  at  the 
state  and  local  levels  as  well.     Thus  we  will  limit  our  policy  analysis 
to  the  establishment  of  these  state  plans. 

Figure  VII-1  illustrates  how  the  federal  policies  originating  in  the 
Title  III  legislation  have  been  parsed  for  the  purposes  of  this  study. 
Only  those  portions  of  the  law  that  are  of  direct  importance  to  establish- 
ing a  Title  III  program  go  past  the  first  level  of  disaggregation  in  the 
diagram.    While  ''Requirements  for  Federal  Administration  of  Title  III" 


Federal 
Title  III 
Policies  @ 


Requirements  for 
Federal  Administration 
of  Title  III  0 


Requirements  for 
State  Participation 
m  Title  III  ^ 


Federal  Requirements 
for  Establishing  a 
State  Program 


® 


Federal  Requirements 
for  State  Administration 


(D 


State 

Critical 

Projects 

Administration 

Needs  ^ 

© 

Program 

(H) 

Dissemination 


FIGURE  VII-1    A  PARSING  OF  TITLE  ill  POLICIES  FOR  KPU  ANALYSIS 


VII-2 


ERIC 


260 


(Box  B)  and  "Federal  Requirements  for  State  Administration"  (Box  E)  exist 
in  great  detail,  they  will  not  be  covered  in  this  report. 

We  expect  that  the  utility  of  this  analysis  will  accrue  primarily 
to  federal- level  agents  who  need  to  understand  why  federal  regulations 
have  such  diverse  effects  across  states.     Such  understanding  should  help 
in  designing  regulations  that  maintain  the  intent  of  Congressional  pro- 
grams without  inadvertently  or  unnecessarily  running  against  state  and 
local  legal  constraints. 

This  case  study  is  presented  in  four  sections..  The  analysis  is  fo- 
cused first  on  explicating  "Federal  Requirements  for  Establishing  a  State 
Program"  (Figure  VII-1,  Box  D) .     Second,  we  present  a  comparative  exposi- 
tion of  the  similarities  and  differences  in  the  responses  to  these  require- 
ments in  three  states.     Third,  we  demonstrate  how  the  state  code  explains 
some  of  these  differences  in  the  California  state  plan.     Fourth,  we  dis- 
cuss how  and  why  the  state  education  agency  managers  of  the  dissemination 
branch  of  Title  III  include  local  policy  and  practice  in  the  design  of 
their  portion  of  the  state  plan. 
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II    FEDERAL  REQUIREMENTS  FOR  STATE  PARTICIPATION  (STATE  PLAN) 

Federal  Title  III  tegulations  require  that  "any  state  desiring  to 
receive  funds  ...   shall,  as  a  condition  to  the  receipt  of  such  funds, 
submit  a  State  plan  to  the  Commissioner  [of  USOE]"  (45  C.F.R.  118.6)."^ 
these  plans,  which  are  the  written  products  of  federal/ state  policy  in- 
teraction, vary  by  state  and  are  the  working  agreement  with  the  federal 
government  by  which  each  state  administers  its  program.     They  address 
two  basic  concerns  (Figure  VII-1,  Boxes  D  and  E).     "Federal  Requirements 
for.  State  Administration"  (Box  E)  deals  with  accounting,   capital  improve- 
ments, and  the  like,  and  wais  not  within  the  scope  of  this  study.  "Federal 
Requirements  for  Establishing  a  State  ""Program"   (Box  D),  however,  deals 
with  the  innovative  projects  program  of  Title  III  and  will  be  explicated; 
these  federal  requirements  may  be  divided  into  four  categories: 

•  Development  of  a  state  program  administration  (Box  F) 

•  Design  of  a  critical  needs  assessment  program  (Box  G) 

•  Establishment  of  a  projects  program  (Box  H) 

•  Provisions  for  dissemination  of  project  results  (Box  I). 

Table  VII-1  summarizes  the  activities  required  for  each  of  the  above  cate- 
gories and  provides  citations  to  corresponding  regulations  and  laws.  Ta- 
ble VII-2  shows  the  regulations  in  greater  detail  and  the  agents  who  are 
designated  the  responsibility  by  law  for  compliance. 


The  federal  requirements  to  which  the  states  must  respond  in  their  state 
plans  are  in  Title  45  of  the  Code  of  Federal  Regulations  (C.F.R. ).  Be- 
cause these  regulations  are  only  summarized  in  this  report,  the  reader 
interested  in  the  full  text  may  wish  to  refer  to  them  directly. 
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Table  VII-1 
FEDERAL  REQUIREMENTS  FOR  STATE  PROGRAMS 


CateRory 

U.S.C. 

C.F.R. 

(F)     Establishment  of  a  state  administration 

20*U.S.C. 

45  C.F.R. 

SEA  shall  appoint  a  State  Advisory  Council  (SAC)  that 
is  representative  of  cultural  and  educational  re- 
sources of  state;  no  SEA  members. 

844a(a)(2)(l)(A) 

118.3(a) 

SAC  will  provide  policy  advice  to  SEA^  recommend  ac- 
tion on  project  applications^  evaluate  Title  III 
programs  and  projects^   and  prepare  an  annual  report. 

844a(a)(2) (1)(A) 

118.4(a)(l-4) 

(G)     Cri'tical  needs  assessment 

20  U.S.C. 

45  C.F.R. 

State  plan  shall  identify  the  critical  educational 
needs  of  the  state^   considering  geographic  areas  and 
population  groups.  ^ 

844a(b)(l)(A) 

118.8(a) 

State  plan  shall  describe  process  by  which  needs  were 
identified,   citing  objective  criteria  and  procedures 
for  data  collection  and  translation. 

844a(b)(l)(A) 

118.8(a) 

(H)     Projects  program 

20  U.S.C. 

45  C.F.R. 

SEA  shall  establish  procedures  to  disseminate  Title 
III  information  and  stimulate  applications  for  funds. 

844 

118.23(a) 

SEA  shall  establish  procedures  for  review  and  disposi- 
tion of  local  project  applications. 

844(b)(3) 

118.24 

SEA  shall  establish  a  Panel  of  Experts  to  review  local 
project  appli cat ions t 

844(b)(3) 

118.23 

State  plan  shall  dascribe  criteria  used  to  evaluate 
project  applications. 

844a(b)(l) 

118.8(a) 

State  plan  shall  establish  criteria  for  equitable 
distribution  of  Title  III  funds^   considering  popula- 
t-T  nn  Hi  <; t- ri  htit-1  nn     distribution  of  relative  needs,  and 
resources  of  different  groups  within  state. 

844a(b)(I) 

118.12 

(I)  Dissemination 

20  U.S.C. 

45  C.F.R.  • 

State  plan  shall  establish  a  program  to  evaluate  ef- 
fectiveness of  Title  III  projects  by  the  State  Advi- 
sory Council. 

844a(b)(6) 

118.8(b) 

State  plan  shall  establish  a  dissemination  program 
for  evaluative  information  about  Title  III  projects. 

844a(b)(6) 

118.8(c) 

State  plan  shall  establish  a  program  for  the  adoption 
and  adaption  of  promising  Title  III  project  compon- 
ents. 

844a(b)(6) 

118.8(d) 
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Ill     RESPONSES  TO  FEDERAL  REQUIREMENTS  FOR  STATE  PROGRAMS 


Using  the  four  categories  of  federal  Title  III  regulations--state 
administration,   critical  needs,  projects  program^  and  dissemination--we 
will  review  the  California,  Nebraska,  and  Washington  state  plans.  The 
comparison  of  each  plan  in  each  or  the  four  categories  is  based  entirely 
on  the  state  plan  documents  provided  to  us  by  the'  states  and  on  the  sum- 
marized regulations  in  Table  VII-1.     The  fiscal  year  covered  is  1973-74. 
Following  each  comparison  is  a  table  that  displays,  side  by  side^  elements 
of  the  state  plan  and  the  federal  requirements  discussed  in  the  narrative. 

Development  of  a  State  Program  Administration 

The  federal  requirements  concerning  the  development  of  a  state  pro- 
gram administration  (Figure  VII-2,  Box  F)  consist  of: 

(I)     The  appointment  of  a  State  Advisory  Council  (SAC)  by 
the  SEA. 

(II)     The  articulation  of  powers  and  duties  for  the  SAC,  once 
established. 

These  requirements,   summarized  in  Table  VII-1,  Row  F,  appear  in  the  first 

column  of  Table  VII-3.     Each  of  the  three  states  has  responded  to  these 

ft 

requirements  somewhat  differently. 

State  Responses  to  Requirements  for  an  SAC 
(Table  VII-3,   Row  I) 

Of  the  three  states  chosen  for  study  in  this  topic,  each  state  ap- 
points its  SAC  differently.     The  California  SEA  has  only  limited  authority 
to  appoint  an  SAC  pursuant  to  the  enactment  by  the  California  legislature 
of  Education  Code  Section  576  (Table  VII-3,  Box  A).     This  section,  which 
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FIGURE  VII-2    A  PARSING  OF  TITLE  III  POLICIES  FOR  KPU  ANALYSIS: 
STATE  ADMINISTRATION 

establishes  the  size,  appointment  procedures,  and  composition  of  the  SAC, 
must  be  obeyed  by  the  SEA  if  the  SAC  is  to  have  legal  validity  under  the 
state  law.     The  result  in  California  is  that  the  SEA  appoints  15  members 
to  highly  categorized  positions;   the  legislature  appoints  five  members, 
and  one  member  is  appointed  by  the  governor.     Only  the  procedure  for  ap- 
pointing the  SAC  is  mentioned  in  the  California  state  plan.     The  members 
of  the  California  SAC  (called  the  Educational  Innovation  and  Planning  Com- 
mission) are  not  named  in  the  California  plan. 

In  contrast,   the  Nebraska  state  plan  (Table  yiI-3^  Box  B)  makes  no 
mention  of  state  code  requirements  for  the  SAC,  arid  the  SEA  itself 
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establishes  no  criteria  for  SAC  selection  beyond  those  established  by  the 
federal  regulations,    Nebraska  does,  however,   give  the  names  of  the  people 
appointed  as  members  of  its  SAC  and  provides  biographic  information  for 
each  to  indicate  compliance  x^ith  the  federal  requirements  for  public  repre 
sentation  and  SAC  composition. 

In  the  Washington  state  plan  the  SEA  expands  on  the  general  categor- 
ies of  the  federal  requirements  (Table  VII- 3,  Box  C).  The  Washington  SAC, 
which  consists  of  14  members,  is  chosen  to  be  representative  of  ten  groups 
including  private  and  public  elementary  and  secondary  education,  business, 
labor,  and  the  low- income  public.  The  names  of  the  members  of  the  Washing 
ton  SAC  are  also  provided  in  the  state  plan. 

State  Responses  to  Requirement  Specifying  SAC  Duties 
(Table  VII- 3,  Row  II) 

The  three  states  responded  directly  to  the  federal  requirements  re- 
garding the  designation  of  powers  and  duties  for  the  SAC.     Although  each 
state  outlined  the  same  basic  powers  and  duties,  the  amount  of  detail  in- 
cluded in  the  state  plans  varied.     California,   for  example^  clearly  desig- 
nates the  responsibilities  of  its  SAC,  citing  the  California  Education 
Code  Sections  576-582. 1  (Table  VII-3,  Box  D).     Within  these  sections  of 
law  is  an  elaboration  of  the  federal  requirements.     These  elaborations 
range  from  the  powers  of  the  Commission,  to  terms  and  provisions  of  office 
and  from  the  utilization  of  the  State  Department  of  Education  (SDE)  staff 
to  the  identification  of  exemplary  projects. 

Neither  Nebraska  nor  Washington  repoirt  in  their  state  plans  any  state 
law  specifically  affecting  the  function  of  their  SACs.     They  do  supply  in 
varying  detail,  however,   the  functions  and  responsibilities  of  their  coun- 
cils (Table  VI-3,  Boxes  E  and  F), 
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Desi&n  of  a  Critical  Needs  Assessment  Program 


The  states  must  comply  with  two  basic  federal  requirements  regarding 
the  development  of  a  critical  needs  assessment  program  (Figure  VII-3, 
Box  G).     They  must: 

(I)  Identify  the  critical  educational  needs  of  the  state. 

(II)  Describe  the  process  by  which  these  critical  needs  were 
identified. 

These  requirements,  summarized  in  Table  VII-1,  Row  G,  appear  in  the  first 
column  of  Table  VII-4. 
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State  Responses  to  Requirement  to  Conduct  Needs- 
Assessment  (Table  VII- 4)^  Row  I)  * 

In  the  California  and  Nebraska  state  plans^   the  critical  needs  are 
condensed  into  succinct  lists  (Tables  VII-4^  Boxes  A  and  B),     In  the  Wash- 
ington plan^  however,   critical  needs  are  not  specifically  identified  (Ta- 
ble VII-4^  Box  C);   instead,   they  must  be  inferred  from  the  formative 
results  of  a  developing  statewide  assessment  program. 

California  reports  the  following  eight  critical  needs:     basic  skills 
(reading  and  math)^   drug  abuse,  bilingual-bicultural  education^  career 
education,   conservation  education,   conflicts  on  secondary  school  campuses, 
early  childhood  education,   and  guidance  and  counseling  services, 

Nebraska  lists  nine  critical  needs:     development  of  programs  for  ex- 
ceptional childre.n,  provision  of  pre-  and  in-service  training  for  teachers 
of  exceptional  children,  assessment  and  development  of  each  child's  po- 
tential, developing  in  children  self-motivation  and  self-direction,  de- 
velopment in  children  of  positive  feelings  about  themselves,  fostering 
continuous  educational  progress  for  children,   involving  the  community  in 
educational  planning,  providing  pre-  and  in-service  training  for  staff 
who  work  under  abnormal  conditions,   and  providing  pre-  and  in-service 
training  for  members  of  local  boards  of  education  (LBEs). 

State  Responses  to  Requirement  to  Describe  Needs 
Assessment  Process  (Table  VII- 4,  Row  II) 

The  California  needs  assessment  program  is  not  conducted  under  the 
aegis  of  Title  III  (Table  VII-4,  Box  D).     Instead,   the  conclusions  from 
programs  that  generate  educational  needs  information  consistent  with  the 
goals  of  Title  III  are  used  by  the  California  Title  III  program.     The  two 
programs  researching  the  California  education  needs  from  which  the  Title 
III  list  is  generated  are  the  project  to  develop  a  Master  Plan  for  the 
State  Department  of  Education,  and  the  program  generated  by  the  Joint 
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Legislative  Committee  on  Educational  Goals  and  Evaluation  and  the  Assembly 
Continuing  Resolution  of  1971  to  develop  school  district  goals.     In  ad- 
dition^  the  California  state  plan  notes  that  it  must  be  responsive  to 
Education  Code  Sections  578.5  and  580  in  choosing  its  critical  needs.  The 
effect. of  these  sections  and  other  state  policies  on  the  formulation  of  the 
California  state  plan  will  be  discussed  in  greater  detail  later  in  this 
study. 

In  Nebraska,   the  staffs  of  the  Title  III  office  and  of  the  Planning 
and  Evaluation  section  of  SDE  share  responsibility  for  the  critical  needs 
assessment  program  (Table  VII-4,  Box  E).     The  state  plan  indicates  that 
these  agents  direct  efforts  toward  annual  validation  and  updating  of  the 
initial  critical  needs  assessment  done  in  1969,   through  a  contract  with  a 
private  agency. 

The  critical  needs  assessment  program  for  Washington  relies  heavily 
on  criterion- referenced  tests,  which  it  contracts  out  to  the  Educational 
Testing  Service  (Table  VII-4,  Box  F).     The  state  plan  notes  that  the  needs 
assessment  efforts  will  serve  as  a  base  for  the  development  of  a  compre- 
hensive **school  improvement  accountability"  program. 

Establishment  of  Projects  Program 

There  are  five  general  federal  requirements  that  the  Title  III  state 
plans  must  address  in  establishing  a  projects  program  (Figure  VII-4,  Box 
H).     These  requirements  are:   

(I)      SEA  shall  disseminate  information  regarding  Title  III. 
 (II)     SEA  shall  establish  project  application  review  procedures. 

(III)  SEA  shall  establish  a  Panel  of  Experts  (POE)  to  review  ap- 
lications.  - 

(IV)  Evaluative  criteria  for  applications  shall  be  discussed. 

(V)  Criteria  shall  be  established  to  assure  equitable  distri- 
bution of  funds. 
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FIGURE  VII-4    A  PARSING  OF  TITLE  III  POLICIES  FOR  KPU  ANALYSIS: 
PROJECTS  PROGRAM 

These  requirements,  summarized  in  Table  VII- 1,  Row        appear  in  the  first 
column  of  Table  VII-5. 

State  Responses  to  Requirement  to  Disseminate  Knowledge 
of  Title  III  (Table  VII-5,  Row  I) 

All  three  states  described  plans  for  disseminating  information  about 
Title  III  to  the  LEAs.     Nebraska's  plan  (Table  VII-5,  Box  B),   the  most 
detailed  exposition,  includes  establishment  of  a  Public  Information  Office 
for  the  public,   individualized  conferences  for  teachers  and  administrators, 
and  distribution  of  brochures  about  the  Title  III  program  and  its  progress 
toward  Nebraska's  critical  needs.     The  California  and  Washington  provisions 
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for  promulgation  (Table  VII-5^  Boxes  A  and  C)  are  less  specific^  but  none- 
theless assure  that  federal  directives  on  the  dissemination  of  program  in- 
formation and  stipulation  of  Title  III  applications  v^ill  be  met. 

State  Responses  to  Requirement  to  Establish  Application 
Review  Procedures  (Table  VII- 5^  Row  II) 

Local  project  applications  go  through  analogous  components  in  each 
state's  review  procedure  (Table  VII- 5^  Boxes  F).     Each  proposal  is 

reviewed  by  a  Panel  of  Experts^  by  state  education  specialists^  and  by 
the  SAC  sometime  before  reaching  the  SEA.     Although  these  components  are 
structured  somewhat  differently  and  come  at  different  points  in  the  re- 
view process^   their  functions  are  largely  similar  across  states. 

In  California  and  Nebraska^   the  review  process  has  two  stages.  Each 
local  project  application  must  first  be  submitted  as  a  planning  proposal 
or  abstract;  which,   if  approved,  may  provide  the  basis  for  a  formal  pro- 
posal.    Formal  proposals  are  then  reviewed  by  each  agent  as  required  by 
federal  regulation  (SAC,  Panel  of  Experts,  and  SEA)  as  well  as  numerous 
SDE  specialists.     Washington,   on  the  other  hand,   requires  no  preliminary 
screening,   and  all  proposals  undergo  a  complete  review  upon  submission. 

State  Responses  to  Requirement  to  Establish  a  Panel 
of  Experts  (Table  VII-5,  Row  III) 

Each  state  plan  provides  for  a  review  of  the  proposals  by  a  Panel  of 
Experts,  as  required  by  federal  regulation.     The  composition  of  that  panel 
varies  greatly,  however.     California  (Table  711-5,  Box  G)  has  a  master  list 
of  approximately  350  experts  from  a  wide  variety  of  fields.     This  list  is 
continuously  updated  and  receives  an  annual  review  by  the  SAC.  Recommenda- 
tions for  appointments  to  the  panel  by  the  SEA  are  made  by  the  Educational 
Innovation  and  Planning  Commission  according  to  the  California  state'  plan. 
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In  Nebraska  (Table  VII-5,  Box  H),   the  Panel  of  Experts  is  selected 
by  the  Assistant  Commissioner,  Division  of  Instructional  Services,  From 
10  to  20  pe^rsons  are  chosen  annually.     The  list  of  prospective  panel  mem- 
bers in  the  state  plan  reviewed  for  this  study  disclosed  no  members  whose 
expertise  was  outside  the  field  of  education. 

The  Washington  Panel  of  Experts  (Table  VII-5,  Box  i)  is  appointed  by 
the  Superintendent  of  Public  Instruction  and  is  said  to  be  representative 
of  educational,  cultura.1,   and  business  agencies  and  the  educationally  hand- 
icapped. 

State  Responses  to  Requirement  to  Develop  Evaluative 
Criteria  -(Table  VII- 5,   Row  IV) 

In  listing  the  evaluative  criteria  to  be  used  for  project  applications, 
each  of  the  study  states  virtually  quotes  USOE * s  State  Administrator's  Man- 
ual for  Title  III.*    To  the  criteria  suggested  by  USOE,  California  (Ta- 
ble VII-5,  Box  J)  adds  that  proposed  projects  must  supplement  the  regular 
school  program  and  provide  an  adequate  plan  for  eventual  adoption  by  the 
project  school.     The  Nebraska  state  plan  lists  only  the  USOE  criteria  (Ta- 
ble VII-5,  Box  K).     Washington  (Table  VII- 5,  Box  L)  adds  two  additional 
criteria:     that  each  proposal  provide  assurances  for  the  participation  of 
nonpublic  school  children,   and  that  equipment  expenditures  be  no  more  than 
15%  of  the  total  project  budget. 

t 


The  State  Administrator's  Manual  is  a  significant  policy  document,  which 
has  the  effect  of  enforcing  the  federal  law  and  regulations-  by  interpret- 
ing their  provisions  and  providing  the  states  with  guidelines  for  opera- 
tion and  prepackaged  state  plan  elements.     The  manual  is  discussed  at 
greater  length  at  the  end  of  this  section. 
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state  Responses  to  Requirement  to  Distribute  Funds 
Equitably  (Table  VII- 5,  Row  V)  , 

State  plan  equity  provisions  concerning  the  distribution  of  project 
funds  also  rely  heavily  on  the  USOE  Administrator's  Manual  suggested 
criteria.     In  California  (Table  VII-5^  Box  M)^  when  proposals  are  rated 
of  equal  need  and  quality^   the  state  plan  provides  three  further  consid- 
erations to  assure  equity  in  the  distribution  of  funds:     the  number  of 
Title  III  projects  already  operated  by  the .LEA^   the  number  of  Title  III 
projects  previously  funded  for  operation  by  the  LEA^  and  the  total  funds 
received  by  the  LEA  since  the  inception  of  the  Title  III  program  in  Cali- 
fornia.    The  Nebraska  state  plan  adds  two  criteria  (Table  VII-5^  Box  N) 
to  the  USOE  suggested  criteria;  these  are  consideration  of  the  LEA  with 
the  greatest  financial  need  and  consideration  of  the  previous  Title  III 
funding  for  the  LEA.     The  Washington  state  plan  (Table  VII-  Box  0)  uses 
only  the  USOE  criteria. 

Provisions  for  Dissemination  of  Project  Results 

There  are  three  basic  requirements  concerning  provisions  for  dis- 
semination of  project  results  (Figure  VII- 5,  Box  I): 

(I)  Establishment  of  a  program  to  evaluate  effectiveness 
of  projects. 

(II)  Establishment  of  a  program  to  disseminate  evaluative 
information. 

(III)  Establishlnent  of  a  program  for  the  adoption/ adaption 
of  promising  project  components. 

These  requirements,  summarized  in  Table  VII- 1,  Box  I,  appear  in  the  first 
column  of  Table  VII- 6. 


VII-22 

279 


Federal 
Title  III 
Policies  @ 


Requirements  for 
Federal  Administration 
of  Title  ill  ^ 


Requirements  for 
Stat^  Participation 

In  Title  III 
(The  State  Plan 


State  Program 
Requirements 


® 


State  Administrative 
Requirements 


State 

•  Critical 

Projects 

Dissemination 

Administration  ^ 

Needs  ^ 

Program  ^ 

0 

FIGURE  VII-5    A  PARSING  OF  TITLE  III  POLICIES  FOR  KPU  ANALYSIS: 
DISSEMINATION 

State  Responses  to  Requirement  for  a  Project  Evaluation 
Program  (Table  VII- 6,  Row  I) 

A  comparative  reading  on  Title  III  dissemination  program  components 
indicated  that  the  three  states  all  use  project  reports  and  site  visits 
to  monitor  progress  toward  their  stated  goals.  Nebraska  and  Washington 
both  require  quarterly  reporting,  while  California  requires  midproject 
and  end-of-project  reports.  The  Nebraska  state  plan  specifies  that  all 
project  goals  be  in  quantifiable  terms  (Table  VII- 6,  Box  B);  California 
and  Washington  accept  anecdotal  information  as  a  component  of  the  eval- 
uation program  (Table  VII- 6,  Boxes  A  and  C). 
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State  Responses  to  Requirements  to  Disseminate  and 
Establish  Promising  Projects  (Table  VII-6,  Rows  II  and  III) 

Although  evaluative  information  is  generally  available,  all  three 
state  plans  place  emphasis  on  the  dissemination  of  promising  practices 
instead  (Table  VII-6,  Boxes  F),     The  following  discussion,  there- 

fore,  deals  primarily  with  the  dissemination  of  promising  practices. 

California  defines  its  dissemination  program  as  the  distribution  of 
print  or  audiovisual  materials  to  create  interest  in  selected  projects 
(Table  VII-6,  Box  D).     The  state  plan  specifically  notes  that  it  publishes 
a  Title  III  newsletter,  maintains  a  library  of  Title  III  products,  and 
develops  conference  exhibits  and  presentations.     In  the  dissemination  of 
information,  emphasis  is  on  the  potential  student  benefits  from  Title  III 
projects.     Here,  as  elsewhere,  California  is  bound  by  state  legislative 
enactments.     A  more  detailed  discussion  follows  in  the  next  section. 

The  Nebraska  plan  (Table  VII-6,  Box  E)  establishes  an  office  to  co- 
ordinate the  Title  III  state  dissemination  effort..    Stated  goals  for  this 
office  are  to  make  all  LEAs  aware  of  the  Title  III  program  intent  and  to 
encourage  the  adoption  of  Title  III  products.     Six  stated  dissemination 
office  activities  range  from  the  development  of  leaflets  and  brochures  on 
each  Nebraska  project  to  the  coordination  of  lecture  tours  for  project 
groups. 

The  Washington  state  plan  (Table  VII-6,  Box  F)  outlines  a  dissemina- 
tion program  based, on  5  goals  aimed  at  10  target  groups.     The  goals  are: 
to  generate  an  awareness  of  Washington's  purposes  and  rationale  for  the 
state  plan;  to  generate  LEA  involvement  in  Title  III;  to  assist  the  LEAs 
in  their  own  dissemination  efforts;   to  encourage  the  continuation  of  in- 
novative developments  in  the  LEAs  after  projects  are  completed;  and  to 
complete  the  necessary  evaluation  information  on  Title  III.     The  ten 
identified  target  groups  for  the  dissemination  effort  are;     public  and 
private  school  administrators;   interested  individuals  in  higher  education; 
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professional  education  groups;  appropriate  philanthropic  agencies;  social^ 
cultural,  medical,  and  business  agencies;  USOE  Title  III  staff;  Washington 
Superintendent  of  Public  Instruction  staff;  Washington  Congressional  dele- 
gation; state  legislators;  and  the  mass  media. 

The  Washington  adoption  and  adaption  program  employs  a  "3  X  3  system." 
LEAs  interested  in  a  successful  project  apply  to  the  Washington  Title  III 
bureau  to  have  the  project  installed  in  their  area.     The  state  arranges 
for  the  close  interaction  of  the  LEA  that  developed  a  project  with  a  maxi- 
mum of  three  LEAs  wishing  to  install  it.     At  the  completion  of  the  full 
project  cycle,  each  of  the  LEAs-  adopting  the  project  in  turn  assists  in 
installing  it  in  three  other  locations. 

The  State  Administrator's  Manual 

In  some  preceding  pages,  and  in  several  of  those  following,  reference 
is  made  to  the.  State  Administrator's  Manual.     This  manual  is  provided  by 
USOE  as  a  service  to  the  states  to  "provide  a  base  of  common  understanding 
among  state  educational  agencies.     A  base  for  building  accountability  into 
projects  and  programs  is  included  also,   to  assist  state  education  agencies 
in  their  role  as  educational  change  agents"  (p.  iv).     The  California  SDE 
reports  that  it  relies  on  this  publication  to  interpret  its  responsibility 
to  the  federal  legislation,  rather  than  attempt  its  own  interpretation. 
The  handbook  and  the  state  legislation  are  its  main  considerations  in  the 
development  and  maintenance  of  the  state  plan. 

This  manual  is  a  significant  policy  tool  for  USOE.     Enforcement  of 
the  federal  requirements  in  the  U.S.C.   and  the  C.F.R.,   in  this  instance, 
is  accomplished  through  the  interpretation  of  the  law  by  USOE  and  through 
providing  examples  for  programming  that  are  assured  of  USOE  acceptance  and 
are  easily  adopted  across  states.    Where  significant,  the  resulting  uni- 
formity of  state  responses  was  noted  in  preceding  sections,  particularly 
the  section  on  ''Establishment  of  Projects  Program.'' 

VII- 26 


2'83 


IV    FORMAL  POLICY  CONSIDERATIONS  AT  THE  STATE 
LEVEL--THE  CALIFORNIA  EXPERIENCE 

In  this  section^  we  explore  the  policy  sources  that  generated  the 
California  state  plan's  "State  Program  Requirements,"    We  have  chosen 
California  as  an  example  of  this  interaction  because  of  the  state's  highly 
articulated  state  Education  Code^  which  makes  the  analysis  more  understand- 
able to  readers  unfamiliar  with  state  education  law. 

The  preceding  section  focused  on  the  federal  program  requirements^ 
outlining  the  state's  responses  as  evidenced  in  state  plan  provisions. 
In  this  section,  the  focus  shifts  to  the  SDE,  and  we  discuss  the  state 
policies  that  directly  influence  the  Title  III  office's  writing  of  the 
state  plan.     To  aid  the  discussion,   the  four  categories  of  state  program 
requirements  (Figure  VII-1)  will  again  be  used,   this  time  to  demonstrate 
the  interaction  of  agents,  policies,  and  activities  at  the  state/ federal 
level. 

The  discussion  of  each  category  is  accompanied  by  a  table  that  sum- 
marizes  the  relevant  state  policies. An d„J:he^f^^  requirements.  The 

state  plan  provisions  that  result  from  the  two  sets  of  policies  are  also 
shown  to  illustrate  the  interaction  of  the  two  sets  of  mandates. 

California  Response  to  Administration  Requirements 
(Table  VII- 7) 

Title  III  mandates  require  that  the  program  be  administered'  by  an 
SEA  under  the  policy  guidance  of  an  SAC  [20  U.S.C.  844(a)(1)(A)]  (Table 
VII-7,  Box  C).     In  Section  576  et  seq.   of  the  California  Education  Code, 
the  state  legislature  designates  the  Educational  Innovation  and  Planning 
Commission  as  the  SAC  for  Title  III  (Table  VII-7,  Box  A).     This  legislation 
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Table  VII-7 


STATE  LEVEL  CONSIDERATIONS  AFFECTING  THE  TITLE  III  CALIFORNIA 
STATE  PLAN  PROVISIONS  FOR  PROGRAM  ADMINISTRATION 


California  Laws  and  Other  ConslderaCloni 

California  State  Plan  Provisions 

Federal  Laws  and  Rejtulations 

California  Ed.  Code  Section  576 

The  Educational  Innovation  and  Planning 
Commission  shall  ba  the  SAC  for  Title 
III  In  California  and  shall  have  the 
powers,  duties,  and  responsibilities 
proscribed  by  Tide  III 

California  Ed.  Code  Section  377 

The  Conimlsslon  (as  the  Title  III  SAC) 
shall  assist  the  SBE  and  SEA  (as  the  - 
SEA) 

Establishment  of  State  Advisory  Commis- 
sion, California  Ed.  Code  376,  Educa- 
tional Innovation  and  Planning  Commission 
One  member  of  Asiembly--appolnted  by 

Speaker  of  Assembly 
One  member  of  Senate--appointed  by  Sen- 
ate Committee  on  Rules 
One  public  member--appolnted  by  Speaker 

of  Assembly 
One  public  member — appointed  by  Senate 

Committee  on  Rules 
One  public  member— appointed  by  Gover- 
nor 

Fifteen  public  members--appointed  by 
State  Board  of  Education: 
One  elementary  school  teacher 
One  secondary  school  teacher 
One  special  education  expert 
One  representative  from  Interests  in 

higher  education 
One  urban  education  expert 
One  member  of  a  governing  board  o£  a 

school  district 
One  representative  from  private 

scho>il  Interests 
One  representative  from  low-Income, 

disadvantaged  areas 
Three  private  Industry  representa- 
tives Interested  In  educational  In- 
novations and  communication 

State  Plan  Section  2.1.1 

The  State  Advisory  Commiosion  for  Title 
III  shall  be  the  Educational' Innovation 
and  Planning  Commission 
This  group  complies  to  Section  376  of 
the  Education  Cede,  which  requires  that 
the  Commission  by  composed  of: 
Professional  members 
Lay  members 
Technical  experts 
Educational  specialists 

(D 

20  U.S.C.  844a(a)(2)(l)(A) 

The  State  Advisory  Council  ...  shall  be 
appointed  by  the  State  Educational 
Agency,  and  be  broadly  representative 
of  the  cultural  and  educational  re- 
sources of  the  state  and  of  the  public, 
including  persons  representative  of: 
Elementary  and  secondary  schools 
Institutions  of  higher  education 
Areas  of  professional  competence  in 
dealing  with  children  needing 
special  education  .because  'of  phys- 
ical or  mental  handicaps 

43  C.F.R.  188.3(a) 

...   including  persons  representative 
of: 

Elementary  and  Secondary  schools 
Institutions  of  higher  education 
Areas  of  professional  competence  in 
dealing  with  children  needing 
special  education  because  of  phys- 
ical or  mental  handicaps 
Areas  of  professional  competence  in 

guidance,  counseling,  and  testing 
Children  from  low- income  families 
and  other  low- income  individuals 

20  U.S.C.  84Aa(a)(2) 

The  SAC  will  provide  policy  advice  to 
the  SEA,   recommend  action  on  project 
applications,  evaluate  Title  III  pro- 
grams and  projects,  and  prepare  an 
annual  repor^t 

20  U.S.C.  822a(2)(l)(A) 

The  state  plan  shall  designate  author- 
ity under  state  law  to  participate  in 
Title  III,  citing  state  laws 

State  Plan  Section  2.1.2 
Advisory 

Advise  SBE  on  the  preparation  and  pol- 
icy matters  arising  under  the  adminis- 
tration of  the  state  plan 

Develop  criteria  for  approval  of  appli- 
cations 

Specify  priorities  on  projects  and 
 fund-ing  ■  

Two  representatives  from  guidance  and 
counseling  Interests 

Two  representatives  with  general  In- 
terests in  education 

® 

Review 

Review  and  make  recommendations  to  the 
SBE  for  action  on  all  Title  III -proj- 
ects 
Evaluation 

Devise  and  apply  criteria  for  an 

annual  evaluation  of  projects 
Make  on-site  evaluations  when  deemed 
necessary 
Report 

Make  an  annual  report  to  Commissioner 
of  USOE  and  to  National  Advisory 
Council  listing  all  activities,  rec- 
ommendations, and  evaluations  (to  be 
forwarded  by  the  SBE),  with  comments 
and  recommendations  from  the  SBE) 

State  Plan  Section  2. l.d 

Chairman  of  Commission  informs  the  Super- 
intendent of  Public  Instruction  of  sup- 
port service  needs 

The  SPI  provides  to  the  extent  feasible 
the  technical,  clerical,  and  profes- 
sional assistance  in  accordance  with 
the  standard  practices  of  the  California 
State  Personnel  Board 

© 

Sections  376-382.1  of  the  California  Ed. 
Code 

Section  377A--The  Commission  shall  have 
the  power  to: 

Review  and  recommend  to- the  SBE  ac- 
tion on  Title  III  proposal! 
Report  activities  to  SBE  for  trans- 
mittal to: 
Governor 
Legislature 
Assist  the  SBE  and  the  SDE  In  plan- 
ning, development,  and  Improvement 
of  state  educational  programs 
Make  evaluations  and  promote  and  ap- 
prove Innovative  programs  and 
schools 

Section  388.3— The  SBE  costs  of  program 
administration  are  covered  by  Title  III 
funds  pursuant  to  Title  III  requirements 
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sets  forth  in  detail  the  composition,  powers,  and  duties  of  the  Commission. 
Section  2.1.1  of  the  California  State  Plan  draws  on  this  information  in 
response  to  the  Office  of  Education's  mandate  on  the  development  of  a 
state  administration  (Table  VII- 7,  Box  B).     In  fact,   the  state  plan  does 
not  elaborate  on  the  nature  of  the  SAC  but  merely  directs  USOE*s  attention 
to  the  state  legislation. 

Similarly,   the  California  State  Board  of  Education  is  designated  by 
Section. 577  of  the  Education  Code  as  the  responsible  agent  for  the  admin- 
istration of  the  Title  III  program  (Table  VII- 7,  Box  D).     Section  2.2  of 
the  state  plan  makes  this  assurance  to  the  Office  of  Education.  Thus, 
both  the  state  plan  and  the  state  law  set  the  Title  III  program  firmly 
within  the  goverance  of  the  larger  State  Education  Agency.     Both  policy 
sources  specify  that  the  "Department  of  Education  shall  administer  and 
enforce  all  laws  of  the  state  required  to  be  administered  by  the  State 
Board  of  Education"   (California  State  Plan,  Section  2.2.1c),  and  that 
within  the  SDE  is  a  Division  of  Instruction,  which  has  a  Bureau  of  In- 
structional  Planning  and  Development.      This  office,  the  state  plan  assures, 
"will  administer,  under  the  State  Board  of  Education  and  the  State  Super- 
intendent of  Public  Instruction,   this  the  California  State  Plan"  (California 
State  Plan,   Section  2. 2. Id). 

In  each  instance  in  which  the  California  state  plan  provisions  have 
been  determined  by  state  law,   the  plan  cites  and  quotes  the  legislation, 
as  opposed  to  restating  it  as  though  it  emanated  from  the  state  Title  III 
office.     By  employing  this  practice,   the  state  program  protects  itself 
from  being  trapped  in  a  policy  conflict.     As  stated  in  the  State  Adminis- 
trator's Manual,  ^the  state  plan  is  a  contract  between  the  states  and  USOE. 


The  California  SDE  Division  of  Instruction  is  the  specific  agent  within 
the  state  government  that  handles  Title  III.     Title  III  is  the  only  pro- 
gram^ for  which  this  office  is  responsible. 
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Thus,   the  Title  III  office  is  legally  obligated  to  meet  the  terms  nego- 
tiated in  the  state  plan.     It  is  also  obligated,   as  a  branch  of  the  state 
government,   to  carry  out  the  responsibilities  delegated  to  it  by  the  state 
government.     By  assuring  USOE  that  it  will  carry  out  the  California  law 
covering  specific  provisions  required  in  the  program,   the  Title  III  office 
protects  itself  from  becoming  contractually  obligated  to  USOE  to  perform 
activities  for  which  it  has  no  legal  authority. 

In  general,    the  legislative  directives  found  in  the  Education  Code 
on  the  organization  of  the  Title  III  administration  are  detailed  enough 
so  that  the  options  the  federal  legislature  allows  the  states  regarding 
the  Title  III  administrative  structure  are  fully  decided  in  the  state 
code.     This  moves  the  focus  of  inputs  on  the  administrative  structure  of 
the  Title  III  office  from  the  agency  level  to  the  legislature.  However, 
other  agents  in  the  state  government  do  have  formal  input  to  the  process 
at  other  points.     For  example,   Section  576  of  the  Education  Code  (Table 
VII- 7,  Box  A)  designates  several  legislative  members  to  the  SAC,   who,  ac- 
cording to  the  federal  regulations,  have  full  voting  privileges  as  members 
of  the  Commission.     However,  because  of  California  Attorney  General  Opin- 
ion No.   65-291  (March  15,   1966),  which  states  that  the  legislative  members 
serving  on  advisory  commissions  may  not  be  voting  members  since  this  would 
create  a  conflict  of  interest  under  California  law,   the  SAC  legislative 
representatives  are  not  allowed  to  vote  on  Title  III  policy  matters.  Con- 
sequently,  only  15  members  of  the  SAC  may  vote;  accordingly,   the  legisla- 
tive representatives  rarely  attend  the  SAC  meetings. 

California  Response  to  Critical  Needs  Assessment  Requirements 
(Table  VII- 8)  ^  '—^ 

Federal  legislation  requires  that  the  state's  critical  needs  in  edu- 
cation be  identified  and  reported  in  the  state  plan  (Table  VII-8,  Box  C). 
These  needs  then  become  the  goals  toward  which  each  state  is  to  orient  its 
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projects  program.     The  State  Administrator's  Manual  is  specific  regarding 
USOE's  expectations  on  the  design  of  the  critical  needs  assessment  proce- 
dure.    This  manual  provides  the  state  Title  III  offices  with  26  "criteria 
for  determining  the  quality  of  an  educational  needs  assessment  strategy" 
(State  Administrator's  Manual^  pp.  26-27)  on  which  it  bases  the  accept- 
ability of  the  provisions  for  assessment  of  critical  needs.     In  the  state 
plans,  USOE  requires  explanation  of  both  the  process  of  needs  identifica- 
tion [20  U.S.C.   844a(b)(l)(A)]   (Table  VII-8,  Box  F)  and  the  information 
generated  from  that  effort  (Table  VII-8,  Box  C).     In  response  to  this 
mandate^,   the  California  state  plan  initially  used  as  its  critical  needs 
the  funding  categories  established  by  the  state  and  federal  requirements 
and  did  not  conduct  an  additional  needs  assessment.      As  Table  VII-8, 
Box  A,   indicates,  however,   the  California  Title  III  office  has  changed 
this  provision.     Now  the  state  determines  the  critical  needs  to  be  ad- 
dressed in  the  program  by  selecting  from  the  list  of  goals  and  concerns 
adopted  annually  by  the  California  SBE  those  areas  relevant  to  the  mandate 
of  the  Title  III  program.     The  state  plan  notes  this  arrangement  and  speci 
fies  that  liaison  activities  be  a  regular  responsibility  for  one  of  the 
program's  consultants;  this  consultant  coordinates  the  Title  III  critical 
needs  requirements  with  the  larger  SBE  state  needs  assessment  program. 

Two  primary  advantages  favor  this  arrangement..    The  first  and  most 
obvious  is  efficiency.     Because  the  Title  III  office  does  not  have  to 
mount  its  own  critical  needs  study  (which  would  merely  repeat  part  of  the 
larger  state  efforts),   the  program  realizes  considerably  savings.  The 


The  federal  and  state  funding  category  requirements  are: 

•  20  U.S.C.  844a(b)(7)  and  (8) 

-  15%  for  handicapped 

-  50%  for  pilot  projects  and  exemplary  progratns 

•  California  Education  Code  Section  580 

-  50%  for  K-6  reading  and  mathematics  projects. 
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state  plan  budgets  only  $18,000  for  critical  needs  assessment  to  pay  for 
the  liaison  activities  of  the  part-time  SDE  consultants  to  the  program. 

The  second  reason  that  the  Title  III  office  relies  on  the  goals  set 
by  the  SBE,   as  opposed  to  developing  its  own,   offers  an  insight  into  the 
operation  of  the  Title  III  office  as  an  example  of  a  state  agency  partici- 
pating in  a  federal  program.     The  California  Constitution  (Article  IX, 
Section  5)  reserves  to  the  state  sole  authority  for  operation  of  the  state 
education  program  and  delegates  responsibility  to  the  SDE  for  carrying 
out  the  duties  and  responsibilities  in  the  state  Education  Code.     As  an 
agent  of  the  SDE,   the  Title  III  office  has  no  legal  authority,  except  as 
derived  from  the  state  government.     Taken  together,  these  provisions  mean 
that  the  Title  III  office  not  only  is  legally  bound  by  state  policies  that 
fall  within  its  mandate,  but  also  (regardless  of  the  federal  view  of  what 
the  Title  III  office  should  accomplish)  can  operate  only  in  the  areas  in 
which  it  is  authorized  to  do  so  by  the  state.     Thus,  when  the  SBE  issues 
a  policy  statement  that  identifies  the  educational  needs  and  goals  to  ba 
pursued,   the  Title  III  office  is  obliged  to  address  the  areas  that  fall 
into  its  jurisdiction.    Although  the  law  does  not  preclude  the  Title  III 
office  from  adding  additional  goals  within  its  authority,   an  SBE  memo  and 
the  state  plans  clearly  require  the  information  needs  of  the  Title  III 
office  for  the  determination  of  critical  needs  to  be  taken  from  the  two 
state  studies  (Table  VII-8,  Box  A). 

Thus,  even  though  the  federal  requirements  for  Title  III  mandate  a 
critical  needs  assessment  program,   the  Title  III  office  has  only  the  au- 
thority as  based  on  the  Education  Code  to  use  the  information  generated 
by  the  two  larger  studies,  and  it  must  form  its  state  plan  contract  with 


Nebraska  budgeted  $42,241  for  needs  assessment  in  its  FY  1973-74  plan, 
and  Washington  for  the  same  period  set  aside  $30,000  for  this  task. 
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USOE  based  on  this  power.     Ruling  on  this  particular  point,   the  State 
Attorney  General  (Opinion  No.  CV71-126,  August  17,   1971)  clearly  stated 
this  policy: 

The  State  Board  of  Education  has  only  those  duties  and  powers 
bestowed  by  the  Legislature...,     The  Legislature  clearly  has 
the  power  to  restrict  the  discretion  of  the  State  Board  of  Edu- 
cation to  allocate  any  funds^  including  those  received  under 
Title  III  ESEA. 

Obviously,   the  state  plan  provisions  for  adopting  the  relevant  SBE 
needs  and  goals  as  the  Title  III  critical  needs  and  the  use  of  information 
generated  by  the  two  state  critical  needs  studies  to  determine  what  other 
goals  and  needs  should  be  set  for  the  program  were  not  merely  a  convenience 
for  the  TitleTII  office;  rather  they  were  a  necessity  imposed  by  higher 
level  policy  agents  in  the  state  government. 


California  Response  to  Projects  Program  Requirements 
(Table  VII-9) 

The  establishment  of  a  projects  program  is  highly  circumscribed  by 
federal  requirements,  most  of  which  address  procedural  concerns  and  the 
formulation  of  equitable  review  criteria.  To  these  federal^  requirements, 
the  Title  III  office  in  California  must  add  the  California  Education  Code 
mandates  in  Sections  578  through  580.  These  two  sets  of  requirements  and 
the  resultant  Title  III  policy  in  the  California  state  plan  are  listed  in 
Table  VII-9. 

In  California,  the  state  plan  sets  up  a  350-member  Panel  of.  Experts, 
selected  by  the  SBE,  to  assist  in  the  assessment  of  project  proposals 
(Table  VII-9,  Box  D).     Section  2.3.2  carefully  outlines  the  criteria  to 
be  used  by  the  POE  for  approving  projects.    Eleven  of  these^ criteria  are 
taken  directly  from  the  State  Administrator's  Manual.    To  these  require- 
ments,  the  state  plan  adds  that  project  proposals  must  show  "adequacy  of 
evidence  that  the  proposed  project  will  supplement  the  regular  school 
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program,  and  '^adequacy  of  plans  for  eventual  adoption  of  the  project  by 
the  sponsoring  local  education  agency"  (California  State  Plan,  p.  18). 
Section  2.3.10  sets  the  program  calendar  and  establishes  the  process  for 
the  disposition  of  proposals  from  the  LEAs.     Finally,  as  required  by  Cali- 
fornia Education  Code  Section  577.5,  the  state  plan  also  specifies  that 
"all  projects  recommended  by  the  Commission  (the  SAC)  shall  be  submitted 
to  the  State  Board  of  Education  for  its  approval."    This  section  accords 
with  the  federal  requirements  authorizing  the  SEA  to  hold  the  final  de- 
cision on  project  funding.     Beyond  the  requirements  noted,  however,  the 
legislature  has  left  the  specifics  of  the  actual  review  process  to  the 
Title  III  Bureau  within  the  SDE. 

Our  study  of  California's  projects  program  has  generated  three 
observations  relative  to  the  way  the  Title  III  office  writes  the  state 
plan.     First,  the  office  has  some  planning  discretion,  even  after  com- 
plying with  all  the  state  and  federal  regulations.     Instead  of  exer-  

cising  that  discretion  by  developing  their  own  specific  objectives  in  the 
state  plan,   the  office  includes  only  the  state  and  federal  requirements, 
thereby  leaving  as  much  room  for  later  administrative  discretion  as  pos- 
sible. 

In  contrast,  however,   the  provisions  for  review  of  rejected  applica- 
tions are  specific.     It  is  significant  that  departure  from  the  norm  falls 
under  due  process^     By  establishing  a  detailed  procedure  for  such  a  sen- 
sitive governance  area,   the  state  plan  contract  protects  the  administrative 
decision  makers  from  emabarrassing  conflicts  and  disputes  about  what  to 
do  in  such  cases. 

Second^   federal  Title  III  requirements  mandate  that  project  money 
not  be  used  to  supplant  state  money  in  the  LEAs  [20  U.S.C.  844(a)(3)]. 
This  provision,  however,   does  not  consider  the  per  capita  based  state  aid 
in  areas  of  declining  enrollment.    -In  1974,  the  Title  III  office  did  not 
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know  until  final  enrollment  figures  were  in  whether  the  number  of  pupils 
served  would  increase  or  not.     If  the  number  had  diminished,   the  average 
daily  attendance  (ADA)  funds  would  have  gone  down,  and  based  on  federal 
legislation  for  Title  III  [20  U.  S.C,  844a(c)]  the  California  program  would 
have  received  only  half  its  allotted  funds.     The  Education  Budget  for 
California  did  increase,  however,   in  1974;   thus,   the  Title  III  program 
received  its  full  allotment. 

The  third  observation  is  that,   in  at  least  one  instance,  a  former 
policy  can  be  detected  in  current  agency  activity.     This  policy  concerns 
the  funding  level  of  a  program  that  was  initially  Title  V-A  of  the  1958 
NDEA.     When  this  program  was  subsumed  under  Title  III  after  passage  of 
the  Education  Amendments  of  1970  (P.L.   91-230),  no  mandates  were  put  on 
the  funding  level  to  be  maintained;  however,   the  Title  III  office  has 
maintained  the  funding  of  this  program  at  its  M)EA  level  and  thus  sets 
aside  about  15%  of  the  project  funds  for  guidance  and  counseling. 

California  Provisions  for  Dissemination  of  Project  Results 
(Table  VII-10) 

The  California  state  plan  carefully  distinguishes  between  dissemina- 
tion of  information  about  the  Title  III  program  and  diffusion  of  promising 
projects.     According  to  Section  2.3.12,1  of  the  plan,  "dissemination  means 
producing  and  distributing  printed  or  audiovisual  materials  among  selected 
au(3iences  to  create  awareness  and  stimulate  interest  in  selected  projects 
and  validated  practices  that  are  solutions  to  needs  or  problems"  (Cali- 
fornia State  Plan,   Section  2,3,12.1),     The  state  plan  then  sketches  the 
activities  it  will  perform  to  meet  its  definition  of  dissemination  (Ta- 
ble VII-10,  Box  E). 

Section  2,3,12,1  of  the  state  plan  defines  diffusion  as  "the  process 
by  which  a  validated  practice  or  a  problem  solution  is  spread  from  the 
field  test  to  its  ultimate  users  or  adopters.    Diffusion  involves  the 
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following  phases:     1.     Awareness/interest  (dissemination),  2.  Visitation/ 
demonstration^   3.     Staff  training^   4.     Implementation  (trial),  and  5.  Eval- 
uation.    Diffusion  is  a  much  larger  concept  than  dissemination  and  requires 
more  planning  and  greater  allocation  of  resources  to  be  effective."" 

Most  important  to  development  of  the  state  plan  provisions  for  the 
California  dissemination  effort^  however^   are  three  sections  in  the  Cali- 
fornia Education  Code.     Section  578  limits  funding  for  any  particular 
Title  III  project  to  three  years;  Section  582  requires  the  SBE  to  select 
"5  to  10  projects  conducted  during  the  current  year  as  'exemplary  proj- 
ects'"; Section  582.1  allows  incentive  grants  for  exemplary  projects^  but 
limits  the  amount  to  no  more  than  5%  of  the  federal  Title  III  allocation. 

Unfortunately^   these  laws  force  the  Title  III  office  to  administer 
an  overcomplicated  and  underfunded  incentive  grants  program.    Having  lasted 
three  years^  a  program  may  not  be  refunded  by  Title  III.     However^  the 
project  group  can  receive  funding  as  an  exemplary  project  by  applying  for 
an  incentive  grant^  which  necessitates  a  new  project  application.  Such 
an  application -must  be  considered  with  all  other  new  program  applications 
and  must^  of  course^   comply  with  federal  requirements  for  new  programs. 
California  SDE  staff  have  indicated  frustration  over  this  obligatory  new 
application  process  and  its  attendant  confusion.    Additionally^   they  have 
indicated  that  the  5%  ceiling  on  dissemination  expenditures  is  inadequate. 

The  SDE  is  seeking  to  change  these  policies  through  Senate  Bill  694^ 
which  is  pending  in  the  state  legislature.     If  passed,  the  law  will  lift  the 
three-year  limitation  from  exemplary  projects,  allow  up  to  25  such  projects, 


In  California,   the  SEA  has  changed  its  focus  since  the  1974  state  plan, 
the  year  under  study  here.     The  dissemination  bureau  within  the  Title 
III  office  has  shifted  to  the  incentive  grants  program.     The  SEA  already 
receives  about  350  proposals,  of  which  it  can  fund  about  50;  attempting 
to  bring  in  more  proposals  would  only  frustrate  the  program  and  the  LEAs, 
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and  raise  the  dissemination  budget  to  157o  of  the  federal  Title  III  alloca- 
tion.    Of  importance  is  that  the  SDE  is  active  in  the  state  political  pro- 
cess relative  to  this  law.    Apparently,   such  participation  is  necessary  in 
states  such  as  California,  \N;hich  have  legislatures  interested  in  regulating 
education. 
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V    THE  OPERATION  OF  A  STATE  OFFICE--THE  CALIFORNIA 
TITLE  III  DISSEMINATION  EFFORT 

In  this  section,  we  discuss  one  phase  of  the  Title  III  program  in 
Calif ornia--the  dissemination  effort.     We  have  illustrated  the  spectrum 
of  state  responses  acceptable  to  USOE  in  meeting  the  Title  III  mandates 
and  have  shown  the  state  level  policies  that  molded  the  California  state 
plan.     We  now  carry  the  analysis  further  by  illustrating  the  dissemination 
operation  of  the  Title  III  office  under  the  policy  set  in  the  state  plan. 

As  previously  noted/  the  basic  dissemination  effort  is  accomplished 
through  the  incentive  grants  program.     These  grants  allow  projects  to 
continue  in  operation  for  facilitating  the  adoption  and  adaption  of  the 
innovative  projects  in  other  districts.     The  Title  III  office  works  with 
the  directors  of  incentive  grants  to  get  information  about  their  projects 
to  potentially  interested  districts  around  the  state.     The  tenor  of  this 
activity  is  set  by  the  following  informal  policies  noted  from  interviews 
with  persons  in  the  California  Title  III  dissemination  office. 

•  Because  the  number  of  Title  III  proposals  greatly  exceeds 
the  number  that  can  be  funded,  dissemination  funds  are  not 
needed  for  advertisement  of  the  program.    Hence,  money  is 
not  expended  for  this  activity. 

•  Only  validated  projects,  proved  successful,  are  dissemi- 
nated. '  Disseminating  ideas  of  dubious  merit  is  a  disser- 
vice. 

•  So  long  as  the  project  districts  are  making  efforts  to  meet 
their  dissemination  agreements,  the  methods  they  employ  and 
the  regulations  they  set  should  be  of  their  own  choosing 
(e.g.,   times  and  places  for  visitation), 

•  The  proper  role  of  the  state  Title  III  dissemination  office 
is  that  of  information  broker.     It  should  provide  a  forum' 
for  communication. 
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•  Initial  project  design  should  be  made  with  an  eye  to  facili- 
tating dissemination.     Specifically^  projects  should  seek  to 
determine  the  set  of  component  problems  to  be  addressed  by 
the  project^  and  the  procedures  by  which  each  problem  will 
be  addressed  and  validated.     The  potential  for  adoption  is 
thereby  enhanced  and  projects  or  components  of  projects  may 
be  more  easily  transplanted, 

•  The  Title  III  office  will  not  demand  that  a  project  apply 
for  a  dissemination  grant.     The  number  of  projects  wanting 
to  disseminate  greatly  exceeds  the  number  allowed  by  law, 
Hence^  the  Title  III  office  would  be  unjustified  in  solic- 
iting an  incentive  grant  application  from  a  reluctant  LEA, 

The  incentive  grant  effort  of  the  state  Title  III  office  has  two 
basic  activities:     the  traveling  seminar  and  the  intensive  producer/con- 
sumer workshops  to  facilitate  project  adoption/adaption.     At  the  beginning 
of  the  academic  year^  the  dissemination  office  and  the  California  County 
Superintendent's  Association  initiate  a  speaking  tour  to  six  regions 
around  the  state.     Each  region  is  under  the  aegis  of  a  chairman  who  works 
with  the  dissemination  office  to  determine  dates  and  generate  interest  for 
seminars  in  the  local  schools,     A  usual  seminar  visit  lasts  only  one  day, 
during  which  nine  projects  are  presented  in  50-minute  talks.     After  noting 
a  consistent  slump  in  afternoon  attendance,  the  dissemination  office  de- 
cided to  conduct  three  sets  of  simultaneous  talks  in  the  morning,  and  to 
use  the  afternoon  for  traveling  to  the  next  seminar  location.     Title  III 
dissemination  funds  cover  the  traveling  seminar  and,  as  far  as  possible, 
later  in-depth  visits.     Funds  for  visits,  however,  are  generally  exhausted 
by  about  February  of  each  year. 

The  Title  III  dissemination  office  relies  entirely  on  the  efforts 
and  expertise  of  the  project  producers  to  convey  to  potential  adopters 
the  technical  information  concerning  their  projects  and  to  resolve  with 
them  any  problems  that  might  impede  adoption  of  the  project.  Interviews 
with  several  County  Education  Offices  showed  that  both  project  producers 
and  project  consumers  have  a  comfortable  working  relationship  with  the 
Title  III  dissemination  office. 
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Four  findings  emerge  from  our  study  of  the  California  dissemination 
effort: 


•  The  Title  III  dissemination  office  generates  as  little  for-- 
mal  policy  as  possible.     Because  it  must  deal  with  both  local 
and  state  policy,  its  operations  appear  somewhat  ad  hoc  and 
more  concerned  with  success  than  with  uniformity  or  procedure, 

•  The  California  approach  to  dissemination  entails  an  exhaustive 
year  of  travel  and  consulting  for  the  project  producer.  It 

is  impossible  to  maintain  regular  classroom  duties  and  be  re- 
sponsible for  an  incentive  grant  at  the  same  time. 

•  The  County  Offices  of  Education  are  supported  in  large  part 
by  grant  money  such  as  Title  III,     They  are  established  pro- 
fessionally to  compete  for,  administer,  and  disseminate 
projects.     Spokesmen  for  one  office  stated  that  perhaps  50% 
of  their  certified  staff  would  have  to  be  released  if  all 
grant  support  were  lost. 

•  The  dissemination  tactics  used  for  Title  III  are  compatible 
with  the  other  project  programs  of  the  LEAs.     One  set  of 
guidelines  for  projects  in  general  covers  Title  III  as  only 
one  of  many  LEA  resources. 
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VI    CONCLUSIONS  AND  RECOMMENDATIONS 


The  value  of  analysis^   for  a  pragmatic  society  like  ours,   lies  in 
the  amount  of  increased  power  it  lends  to  the  policy  planning  and  assess- 
ment  process.     Our  analysis  of  Title  III"  has  resulted  in: 

•  Conclusions  about  how  policies  interact  in  Title  III  plan- 
ning. 

•  Conclusions  about  the  utility  of  this  approach  to  the  study 
of  policy  and  KPU  in  general. 

•  The  use  of  this  topic  in  developing  and  testing  the  "Analytic 
Framework  for  Educational  Policy  Analysis," 

Conclusions  on  Policy  Interaction  in  Title  III  Planning 

The  states  have  and  jealously  guard  their  X^g^l  authority  over  public 
education,  but  the  federal  government  provides  the  overwhelming  proportion 
of  funding  for  flexible  KPU  efforts.     Thus  Title  III  is  operated  in  an 
environment  in  which  the  federal  government  provides  the  resources  and  the 
state  governments  hold  the  bulk  of  authority  for  managing  those  resources. 
Apparently,   this  puts  state  education  agencies  between  Scylla  and  Charybdis; 
they  must  answer  to  the  federal  government  for  the  resources  that  keep 
their  efforts  alive  and  to  the  state  government  for  the  authority  to  engage 
in  those  efforts. 

However^   this  tension  can  be  a  source  of  bureaucratic  freedom  for  a 
bold  Title  III  SEA  staff.     The  reasons  are  as  follows: 


Because  the  central  task  in  the  Normative  Structuring  Project  is. the  de- 
velopment and  testing  of  an  analytic  framework,   this  discussion  was  devel- ^ ; 
oped  only  far  enough  to  serve  in  that  task. 
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•  Federal  Title  III  policies  are  all  based  on  incentive;  that 
is,  states  fall  under  their  jurisdiction  only  if  they  want 
to  pick  up  federal  support^  which  is  the  incentive.  Because 
no  state  has  refused  this  support,   the  federal  government 
has  been  able  to  establish  the  framework  for  state  responses 
and  to  specify  the  domain  open  to  negotiation, 

1      •    As  the  administrative  arm  of  the  state  legislature,   the  SEA 
must  negotiate  within  the  authorization  and  limitations 
placed  on  it  by  state  law.     This  allows  the  SEA  to  cite  re- 
strictions and  precedent  to  federal  agencies  when  it  nego- 
tiates its  response  to  Title  III  guidelines. 

•  Because  there  are  differences  among  states — reflected  in 
their  state  codes-- there  are  and  will  continue  to  be  differ- 
ences in  their  responses  to  federal  initiatives  such  as 
Title  III. 

•  Capable  staff  in  SEA  Title  III  offices  could  balance  federal 
and  state  requirements  to  maximize  their  own  options  and  to 
minimize  stress  from  either  level  of  government.     This  strat- 
egy entails  incorporating  only  the  minimum  federal  and  state 
constraints  in  the  state  plan. 

•  SEAs  must  construct  state  plans  to  avoid  accepting  mandates 
or  goals  they  will  not  be  able  to  enforce  at  local  levels. 
This  requires  knowing  the  policies  and  operating  procedures 
of  the  local  education  agents.     On  the  other  hand^  by  in- 
corporating their  agenda,   carefully  worded,   into  the  state 
plans  (even  policies  not  strictly  required  by  the  states  or 
the  federal  government),   the  agency  can  bolster  its  author- 
ity over  local  agents  relative  to  questionable  points. 

•  Once  in  effect,   state  plans  create  constituencies.  While 
these  constituencies  make  it  difficult  for  the  SEA  to  effect 
major  changes  in  Title  III  operations,   they  are  allies  for 
the  SEA  in  its  defense  of  programs  from  outside  attack. 

Conclusions  on  the  Utility  of  This  Approach  to  the  Study 
of  Policy 

This  type  of  analysis  has  utility  in  that  it  reveals  implications  for 
Title  III  and  similar  programs,  and  it  suggests  ways  to  monitor,  policy  in 
general. 
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Concerning  Title  III,   the  analysis  is  an  effective  method  for  showing 
how  SEAs  are  constrained  in  their  attempts  to  set  up  and  run  federally 
sponsored  programs.     The  approach  shows  the  policies  that  are  sources  of 
tension  between  federal  and  state  agencies  and  suggests  how  SEAs  can  seek 
resolution  of  such  tensions  to  their  own  benefit.     Finally,   this  approach 
reveals  the  real  degree  and  form  of  state  sensitivity  to  "local  control," 
which  all  states  claim  to  have. 

Concerning  the  monitoring  process  itself,   this  study  suggests  that, 
where  policies  are  clustered  around  programs,   there  is  a  key  set  of  core 
policies  (in  this  case,   those  regulating  the  construction  of  a  state  plan). 
This  key  set  is  a  clear  function  of  the  purpose  of  the  program.     By  identi- 
fying this  purpose  as  the  purpose  of  analysis,   one  can  employ  an  efficient 
Strategy  for  identifying  the  most  significant  policies.      The  analyst  should 
should  take  note,  however,   that  the  analytical  framework  does  not  offer 
the  researcher  an  effective  means  of  investigating  or  discussing  the  use 
of  policy  for  any  other  purpose  than  as  stated.     For  example,   there  is  no 
way  to  indicate  instances  in  which  formal  policy  can  be  used  as  an  enforcer 
on  an  informal  policy  agenda. 

Recoitnnended  Studies  for  NIE  in  Anticipation  of  a  Monitoring 
System 

As  a  result  of  this  analysis,  the  following  three  studies  seem  desir- 
able relative  to  further  preparation  for  a  monitoring  network. 

Study  One--In  researching  this  topic,  we  found  that  a  significant 
number  of  LEAs  are  beginning  to  contract  with  service  agencies  for  services 


Locating  records  of  significant  public  policies  is  not  a  ^serious  limita- 
tion.    Most  policy  is  on  public  file  and  fairly  well  indexed.  Moreover, 
even  local  district  policy  is  increasingly  being  codified  and  indexed  be- 
cause of  court  and  public  pressures  for  open  access  and  due  process. 
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such  as  the  codification  of  their  policies  and  the  monitoring  of  policies 
emanating  from  higher  levels  of  governance  of  which  they  must  be  aware. 
The  Southern  Carolina  School  Boards  Association,   for  example,  has  been 
active  in  policy  codification  for  various  LEAs  in  the  Southeastern  states. 
This  group  is  able  to  do  an  initial  codification  task  in  a  typical  LEA 
for  between  $2500  and  $5000,  with  the. cost  of  updating  running  about  $400 
per  year.     In  California,  a  publication  entitled  the  California  School  Law 
Digest  keeps  the  LEAs  abreast  of  the  judicial  decisions  affecting  the  op- 
eration of  California  schools.     This  digest  is  published  monthly  and  costs 
$30  per  year. 

We  hypothesize  that  the  general  adoption  of  these  services  by  the 
LEAs  would  greatly  enhance  NIE * s  policy-monitoring  capability.     Instead  of 
attempting  to  build  an  extensive  policy  information  bank — extremely  expen- 
sive both  in  terms  of  initial  development  and  updating--NIE  policy  analysts 
would  need  only  to  learn  how  to  use  the  various  codes  and  other  services 
being  produced  at  the  local  and  state  levels.     For  this  reason,  we  suggest 
that  NIE  investigate  the  various  services  available.     By  informing  and  en- 
couraging the  LEAs  relative  to  the  availability  of  the  various  legislative 
information  services,  NIE  might  increase  further  the  rate  at  which  local 
education  policies  are  becoming  codified  and  hence  available  in  a  realistic 
sense  for  policy  analysis. 

Study  Two--To  locate  the  significant  state  and  federal  policies  for 
this  topic,   our  staff  members  found  it  necessary  to  learn  the  basic  tech- 
niques of  legal  research.     Although  this  research  skill  is  not  difficult 
to  acquire,  we  suspect  that  few  educational  researchers  or  policy  analysts 
possess  this  particular  skill,   since  it  is  usually  taught  only  in  law 
school.     We  suggest  that  NIE  consider  ways  in  which  to  make  these  skills 
available  to  researchers,  both  in-house  and  in  the  field. 
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Study  Three--One  of  the  key  phenomena  pursued  by  the  initial  Title 
III  research  effort  was  the  existence  of  policy  conflicts  and  debilitating 
overloads  of  policy  for  specific  agents.     Although  we  examined  only  a 
limited  number  of  agents,  we  found  these  concerns  to  be  unfounded.  More- 
over, we  noted  that  the  educational  governance  system  provides  a  number 
of  ways  in  which  agents  can  and  do  deal  with  situations  to  avoid  policy 
conflicts  or  overloads.     These  range  from  delegating  authority  to  lower 
level  agents  to  changing  laws. 

We  feel  that  this  is  an  important  finding,  but  it  is  based  on  evi- 
dence too  superficial  to  be  definitive.     Therefore,  we  suggest  that  NIE 
study  the  variety  of  ways  in  which  agents  respond  to  potential  policy 
conflicts  or  overloads,   to  determine  whether  they  truly  present  debilitat- 
ing problems  or,   as  our  preliminary  observations  indicate,  whether  the 
problems  are  mostly  myth. 

Miscellaneous  Conclusions  and  Recommendations 

The  basic  intent  of  the  Title  III  study  was  to  contribute  to  the 
generation  of  the  analytic  framework,  rather  than  to  investigate  Title 
III.    However,  we  came  across  several  findings  that  do  not  spring  from  . 
the  approach  settled  on  as  the  analytic  framework;  believing  this  infor- 
mation to  be  useful,  we  offer  it  as  a  final  '*grab  bag"  of  observations 
on  Title  III. 

•     Relative  to  the  size  of  its  investment  in  the  Title  III  pro- 
gram, the  federal  government  receives  large  dividends  along 
several  dimensions.     For  example.  Title  III: 

-  Provides  a  communication  link  between  the  federal  govern- 
ment and  the  states  on  their  perceived  needs  and  interests 
in  KPU. 

-  Provides  a  communication  link  among  the  states  concerning 
alternative  ways  to  approach  the  doing  of  KPU. 

-   -  Focused  the  authority  for  determining  the  critical  needs 
of  education  on  the  SEA. 
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-  Strengthened  the  SEAs  through  provision  of  a  revenue  source 
and  purpose. 

-  Generated  discussions  and  research  at  every  level  of  the 
educational  administration  within  the  states  concerning 
the  nature  of  the  educational  problems  facing  the  state 
and  possible  innovative  solutions. 

One  agency  administrator  noted  that  most  project  applications 
being  received  were  not  innovative  or  creative  in  their  ap- 
proach to  critical  needs.     A  study  might  be  done  to  assess 
the  qualities  of  the  KPU  agenda^  of  classroom  teachers.  Per- 
haps the  classroom  teacher's  needs  for  KPU  are  different 
from  the  services  offered  by  Title  III.     This  study  should 
assess  the  application  process  for  Title  III  projects,  and 
compare  the  KPU  activities  in  which  teachers  search  for  funds 
from  programs,  such  as  Title  III,  with  those  in  which  teachers 
merely  participate  without  seeking  external  funds. 

Researching  various  states  revealed  interesting  alternative 
project  funding  patterns.     NIE  might  find  it  useful  to  assess 
the  relative  merits  of  various  arrangements.     For  example, 
California  has  both  a  projects  grants  program  and  an  incentive 
grants  program  (discussed  earlier).     The  Nebraska  projects 
program  operates  two  basic  types  of  grants:     the  usual-sized 
Title  III  projects,  and  a  minigrants  program  for  special  one- 
year  projects  not  to  exceed  $2500. 

To  prevent  problems,  an  inquiry  into  the  treatment  afforded 
teachers  in  federal  education  programs  might  be  judicious. 
Are  they  equitably  compensated  for  their  efforts?-   Does  the 
program  carry  adequate  incentives  to  encourage  participation 
or  does  it  carry  disincentives  that  sap  the  interest  of 
teachers?     For  example,  the  incentive  grant  program  in  Cali- 
fornia requires  such  a  rigorous  effort  on  the  part  of  the 
teachers  that  it  is  inadvisable  for  a  teacher  to  hold  a  regu- 
lar teaching  position  and  an  incentive  grant  at  the  same  time. 

Although  the  fund  allotments  for  Title  III  are  small  com- 
pared with  the  total  budget  for  education,  they  represent  a 
disproportionately  large  amount  of  flexible  spending  since 
they  are  earmarked  for  KPU  and  yet  le.ft  open  on  the  problems 
they  may  tackle.    By  inference,  although  education  is  a 
tremendously  large  industry,  little  money  is  available  to  ■ 
the  LEAs  for  experimentation.     The  governing  agencies  have 
tightly  earmarked  virtually  all  the  funds  coming  into  the 
LEAs.    NIE  should  develop  strategies  for  generating  more 
KPU  funding  and  getting  it  to  the  classroom. 
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One  requirement  for  the  SDEs  with  regard  to  Title  III  is 
that  the  money  be  used  to  supplement,  not  supplant,  local 
funds.     This  requirement  was  written  in  a  time  of  growth 
for  the  LEAs,  and  the  base  used  was  the  gross  dollar  amount 
of  state  aid  delivered  to  the  schools.    With  declining  en- 
rollments,  this  requirement  has  been  a  problem  for  some 
states.     The  amount  of  state  aid  is  based  on  the  ADA,  and, 
although  the  funding  commitment  may  be  the  same,   the  level 
may  drop  due  to  a  drop  in  the  number  of  students.  Care 
should  be  taken  that  this  type  of  requirement  is  not  in- 
corporated into  the  Title  IV  restructuring  of  the  Title  III 
program  or  other  education  programs. 
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VII    THE  USE  OF  THIS  TOPIC  IN  DEVELOPING  AND  TESTING  THE 
ANALYTIC  FRAMEWORK  FOR  EDUCATIONAL  POLICY  ANALYSIS 


The  analysis  of  Title  III  presented  in  this  paper  was  conducted  to 
meet  three  needs,  none  of  which  was  for  the  explication  of  Title  III  per 
se.     The  topic  was  investigated  to  provide  an  empirical  test  for  the  for- 
mation of  the  basic  conceptual  framework  for  a  large  NIE  project  entitled 
"a  Methodology  for  Describing  the  Inf rastrcture  of  Educational  R&D,**  Cen- 
tral to  this  larger  study  was  the  design  of  an  analytic  framework  for 
conceptualizing  the  governance  infrastructure  of  KPU  (see  the  main  volume 
of  this  study).     Incidental  to  development  of  this  analytic  framework  was 
the  development  of  a  guide  for  using  that  framework. 

Therefore,   this  analysis  was  conducted: 

•  To  help  create  and  assess  the  usefulness  of  the  key  ideas 
that  eventually  made  up  the  analytic  framework, 

•  To  explore  in  detail  one  of  those  ideas, 

•  To  show  one  of  the  ways  that  the  analytic  framework  could 
be  employed  to  organize  the  presentation  of  policy  analysis. 

Title  III,  unlike  the  other  case  studies,  however,  was  used  not  so 
much  to  test  the  analytic  framework,  as  to  be  the  trial  problem  for  the 
development  and  refinement  of  the  set  of  concepts  that  became  the  analytic 
framework. 

Analytic  Framework  Ideas  from  Title  III 

We  found  that,  as  a  first  step  in  the  inquiry  process,  it  is  more 
useful  to  determine  the  focus  of  the  inquiry  and  gather  information  to 
that  end  that  it  is  to  attempt  to  learn  all  there  is  to  know  about  a 
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topic  or  to  formulate  and  test  an  a  priori  assumption  about  the  nature 
of  the  program. 

After  settling  on  this  "focus-of-inquiry  strategy,"  for  the  Title 
III  study  we  selected  the  role  of  the  SEA,  the  Title  III  administrative 
agent,  as  our  focus  of  inquiry  and  began  constructing  the  configuration 
of  agents  and  policies  that  give  rise  to  Title  III  administration  at  the 
state  level. 

Characteristics  of  Configurations 

For  a  thorough  understanding  of  configurations,   thinking  was  neces- 
sary on  three  levels.     First,  we  had  to  divide  larger  configurations  into 
their  subconf igurations,  and  determine  their  elementary  components.  This 
required  collecting  enough  information  about  these  elementary  components 
to  understand  how  the  configurations  work  internally.     Finally,  we  had  to 
select  some  perspectives  with  which  to  recognize  and  interpret  the  pat- 
terns and  interconnections  among  configurations. 

Elementary  Components  of  Configurations 

While  the  activities  that  constitute  a  program  such  as  Title 
III  can  be  conceptually  subdivided  ad  adsurdum,  there  is  a  point  below 
which  the  purpose  of  the  activity  relative  to  the  whole  of  Title  III 
ceases  to  be  self-evident.     It  is  this  distinction  that  leads  to  the 
drawing  out  of  the  most  elementary  configuration.     In  addition  to  iden- 
tifying the  purpose  around  which  to  form  an  elementary  configuration,  it 
is  necessary  to  know  its  agents,  resources,  and  policies. 

Relationships  Among  Components 

In  addition  to  the  four  characteristics  that  make  up  elementary 
configurations,  we  found  it  ijseful  to  know  two  characteristics  of  configu 
ations  as  wholes:    how  they  conceptually  fit  .together  as  stages  of  larger 

vii-54  r 


configurations,  and  how  they  change  through  time.     In  the  Title  III  study^ 
we  started  by  staging  the  activities  assumed  necessary  for  administration 
of  Title  III,  based  on  a  general  understanding  of  administrative  agencies 
and  Title  III.     This  tactic^  however^  proved  ineffective.     To  account  for 
the  activity  stages^  we  found  it  far  more  useful  to  put  aside  our  precon- 
ceived ideas  of  how  Title  III  might  be  administered  and  determine  how  to 
parse  the  activity  stages  based  on  federal  policy  and  information  in  the 
State  Administrator's  Handbook. 

After  breaking  the  administration  of  Title  III  into  its  compo- 
nent stages  of  activity  J,  we  found  the  information  useful  to  the  larger 
study  for  two  purposes.     First^,  the  administration  of  Title  III  is  very 
much  a  series  of  events  in  which  the  role  of  agents  within  the  SEA  admin- 
istration varies  in  importance  according  to  the  subtask  being  performed. 
Breaking  out  these  stages  enabled  us  to  understand  the  realistic  contribu- 
tion of  the  agents  at  various  points  in  the  program  administration.  Sec- 
ond,  staging  provides  a  useful  technique  for  discussing  the  findings.  By 
presenting  and  explaining  configurations  and  their  perceived  significance 
at  this  more  detailed  level,  we  were  able  to  explain  the  larger  program 
by  building  a  mosaic. 

We  found  three  dimensions  of  time  to  be  useful  as  frames  of  reference 
for  studying  the  basic  configurations.     The  first  is  program  evolution. t 

Reading  and  interpreting  the  text  of  legislation  is  an  arduous,  time- 
consuming  task,  especially  for  policies  as  complex  as  Title  III.  For 
this  reason,  one  of  the  important  roles  of  administrative  agencies  (in 
this  case,  USOE)  is  in  issuing  handbooks  that  explain  and  clarify  the 
meaning  of  legislation.    For  the  study  of  any  policy,  the  analyst  should 
always  seek  out  the  administrative  guidelines  (handbook)  as  an  aid  and 
check  to  the  understanding  of  the  policy.     The  State  Administrator's  Hand- 
book proved  to  be  extremely  valuable  in  parsing  the  Title  III  staging. 
For  a  more  detailed  explanation  of  this  particular  document,  see  p.  26. 

''^Initially,  we  attempted  to  discuss  the  role  of  the  SEA  in  the  administra- 
tion of  Title  III  by  tracing  its  evolution  from  the  inception  of  the  pro- 
gram.   We  found  this  to  be  an  exhausting  effort  that  yielded  only  marginal 
insights  about  the  SEA  administration  role, 

VII-55 


We  noted  that  SEA  administration  activities  for  Title  III  have  changed 
over  time.     The  chief  value  in 'investigation  of  program  evolution^  however 
lies  in  determining  what  program  options  have  been  tried  and  abandoned. 

The  second  useful  dimension  of  time  is  the  sequencing  of  the 
above-mentioned  stages  of  activities.     Investigation  of  Title  III  reveals 
that  SEA  administration  was  intended  to  follow  a  particular  sequence  in 
satisfying  the  activity  mandates.     We  noted  the  rational  policy  planning 
subtending  this  feature^  which  led  us  to  consider  the  value  of  proper 
activity  sequences.     Our  contention  is  that  Title  III  administration  prof- 
ited  by  conscious  attention  to  the  sequencing  of  stages  of  activity. 

The  third  dimension  of  time  noted  to  be  a  valuable  analytic 
frame  of  reference  is  the  cyclic  nature  of  some  policies.     In  our  study 
of  Title  III  we  found  that  the  combination  of  a  short  cycle  time  (12 
months)  and  a  long  procedure  time  for  midcycle  amending  of  the  state  plan 
meant  that  all  amendments  to  the  state  plan  are  done  at  the  beginning/end 
of  cycles.     Therefore,  monitoring  the  state  plan  as  the  key  policy  in  the 
administration  of  Title  III  requires  only  a  yearly  update  of  records. 

The  Role  of  the  Policy  Administrator 

Identifying  the  position  of  authority/ responsibility  of  any  agent 
with  respect  to  other  agents  and  activities  proved  valuable.    We  found 
that  the  SEA  (as  both  an  enforce/administrator  of  a  federal  program  and 
as  a  line-authority  agent  of  the  state  school  system)  must  find  a  way  to 
be  responsive  to  both  the  federal  and  the  state  program  mandates  and, 
moreover,  must  be  responsive  in  a  manner  that  will  be  workable  for  the 
agency,  i.e.,  one  that  is  enforceable.    When  considering  the  rationale 
for  the  SEA  policies,   the  analyst  must  consider  the  enforcer's  obligations 
to  be  both  policy- responsive  and  enforcement-capable,  or  a  realistic 
perspective  is  not  possible*  * 

VII-56 


311 


The  analysis  of  the  SEA  in  the  setting-enforcing-comp lying  implement- 
ting  hierarchy  yielded  two  additional  insights.     Rather  than  noting  policy 
conflicts  as  a  problem  for  administrators,  we  found  that  adroit  agents  use 
them  to  strengthen  their  capacity  to  build  their  own  agendas  through  chal- 
lenging individual  activity  mandates  on  the  grounds  of  a  policy  conflict. 
Second^  we  noted  that  enforcing  agents  will  also  negotiate  obligatory  ac- 
tivities with  policymakers  in  areas  within  their  authority  on  agendas  they 
want  but  suspect  the  compliers  will  find  objectionable.     This  gives  them 
an  added  force  of  authority  they  do  not  generally  seek  for  activities 
deemed  to  be  amenable. 

Formal  Policy  as  a  Data  Source 

Title  III  is  the  product  of  a  political  process;  its  features  are 
sketched  by  federal  legislation  and  detailed  by  the  states.     We  found  the 
formal  policies  driving  this  program  to  be  information- rich  data  sources. 
Through  reference  to  only  the  formal  policy  sources,  we  were  able  to  con- 
struct the  configuration  of  elements  for  Title  III. 

One  aspect  of  relying  on  formal  policy  as  a  data  source  that  should 
be  noted  by  researchers  unfamiliar  v;ith  legal  research  is  that  the  inquiry 
process  only  begins  with  reading  the  statutes.     The  researcher  must  also 
locate  the  legal  guidelines  issued  by  the  enforcement  agency,   the  court 
cases  bearing  on  the  study,  and  (if  any  exist)  opinions  of  attorneys  gen- 
eral.    Once  this  comprehensive  effort  is  completed,  we  conclude,  on  the 
basis  of  the  Title  III  research,  that  the  researcher  will  have  the  com- 
plete set  of  data  necessary  to  generaite  configurations,  which  can  then  be 
examined' within  the  frames  of  reference  noted  above. 

Gathering  data  from  formal  policy  is  valuable  along  other  dimensions 
as  well.     Such  data  represent  the  activities  agreed  upon  by  agents,  as 
opposed  to  interview-based  research  that  represents  only  the  composite 
opinion  of  the  agents  interviewed.    Also,  certain  of  the  formal  policy 
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negotiation  forums  are  reserved  for  resolution  of  differences.     By  noting 
what  portions  of  the  activity  have  been  taken  into  a  forum  for  resolution 
of  problems,  such  as  a  court  case  or  attorney  general  opinion,  the  re- 
searcher achieves  insight  into  tension  points  in  the  program.     By  noting 
the  forum  sought,   the  researcher  can  assess  the  intensity  of  this  tension. 

A  final  factor  enhancing  the  utility  of  legal  research  for  data  gath- 
ering is  the  utility  of  the  legal  annotation.     In  an  annotated  code,  the 
publisher  provides  the  researcher  with  full  information  on  the  legal  evol- 
ution of  the  policy,  points  out  the  other  sources  of  data  on  policy,  and 
notes  any  legal  journal,  digest,  or  legal  encyclopedia  references  relating 
to  the  policy.    Mastering  this  research  technique  results  in  rapid  data 
gathering. 

How  the  Guide  to  the  Use  of  the  Analytic  Framework  Was  Employed 
to  Organize  This  Title  III  Analysis  for  Written  Presentation 

^  Simultaneously  with  the  development  of  the  analytic  framework,  the 
project  staff  struggled  with  the  problem  of  efficient  application  of  the 
framework  to  given  analytic  problems.     The  result  of  the  struggle  was  the 
creation  of  a  five-step  method  whose  use  is  illustrated  in  Case  Studies 
I  and  IX. 

Because  the  specifics  of  this  method  were  created  after  most  of  the 
Title  III  data  had  been  collected  and  organized,  it  was  not  too  useful 
for  the  Title  III  analysis.     In  fact,  much  of  the  trial  and  error  of  con- 
ducting the  Title  III  analysis  influenced  the  development  of  the  method. 
However,   the  method  did  contribute  to  organizing  the  results  of  the  anal- 
ysis for  written  presentation. 
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I  INTRODUCTION 


Intermediate  Service  Agencies  (ISAs)  is  a  term  used  here  to  identify 
a  whole  range  of  organizations  that  undertake  knowledge  production  and 
Utilization  (KPU)     and  other  educational  activities  on  a  multidistrict 
rather  than  a  local  or  state  education  agency  (SEA)  basis.     As  part  of 
the  KPU  system^   they  perform  diverse  activities  such  as  R6eD^  operation 
of  in-service  training  for  teachers^  maintenance  of  KPU  linkage  systems 
like  ERIC^  and  the  general  coordination  of  KPU  for  their  component  mem- 
bers.    Other  major  ISA  activities  include  special  education^  vocational 
education^  education  for  the  handicapped^   and  administrative  support  for 
member  organizations;  in  fact^  non-KPU  responsibilities  appear  more  fre- 
quently as  the  raison  d'etre  for  intermediate  agencies  than  do  KPU  activi- 
ties. 

The  general  philosophy  underlying  the  establishment  and  continuing 
growth  of  ISAs  is  that^  through  economies  of  scale^   they  can  provide  cer- 
tain services  more  economically  and  more  efficiently  than  can  their  com- 
ponent districts  or  schools.     From  the  perspective  of  governance^  ISAs  are 
closer  to--and^  by  implication^  can  be  more  responsive  to  needs  of-- their 
potential  users  (mainly  teachers  and  local  administrators)  than  the  SEAs, 

Smaller  school  systems  in  many  states  have  combined  their  re- 
sources in  an  effort  to  obtain  necessary  services  ...  when  it 
has  been  deemed  impossible  or  inadvisable  for  them  to  develop 
such  programs  independently  (Colella  and  Foster^  1974). t 

The  term  KPU  encompasses  all  activities  related  to  research^  development^ 
dissemination^  and  adoption  of  new  knowledge  for  the  improvement  of  edu- 
cation. 

^A  list  of  references  follows  this  case  study.  There  is  an  extensive  lit- 
ature  on  intermediate  agencies;  several  key  reports  are  noted  in  the  bib- 
liography, 
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Some  forms  of  intermediate  administrative  agencies  already  exist  in 
all  50  states  (Lavin  and  Sanders,   1974),     A  recent  report  by  Stephens 
(1975)  provides  detailed  summaries  of  what  the  author  calls  Regional  Edu- 
cation Service  Agencies  (RESAs)  in  12  states  (Table  VIII-1);  he  groups 
RESAs  into  two  categories:     those  authorized  by  mandated  legislation  (i.e., 
component  districts  or  schools  are  required  to  join)  and  those  authorized 
by  permissive  legislation  (i.e.,   component  members  join  on  a  voluntary 
basis).     Stephens  looked  especially  at  governance,   showing  selected  orga- 
nizational and  financial  characteristics  for  each  of  the  RESAs;  his  find- 
ings are  reproduced  in  Tables  VIII-2  through  VIII-5. 

This  paper  is  part  of  a  report  on  formal  policies  that  govern  KPU 
agencies  and  activities  in  general;  here  we  describe  the  policy  environ- 
ment within  and  surrounding  two  kinds  of  ISAs  that  do  KPU.     These  orga- 
nization are  Boards  of  Cooperative  Services  (BOCS)  in  Colorado  and  Boards 
of  Cooperative  Educational  Services  vSOCES)  in  New  York. 

Organization  of  the  Paper 

The  paper  is  organized  in  four  sections.     The  introduction,  objectives 
fo.r  this  analysis,  background  information  about  the  BOCES,  and  an  abstract 
of  our  findings  and  recommendations  make  up  the  first  section.     Second  is 
a  detailed  description  of  governance  in  the  Colorado  BOCS  system;  third 
is  a  description  of  the  New  York  BOCES  system.     The  fourth  section  is  a 
comparison  of  the  two  governance  systems,  with  conclusions  and  recommenda- 
tions.    In  addition,  a  taxonomy  of  the  major  BOCES  policies  in  both  states 
is  presented  in  Annex  A. 


When  referring  to  both  organizations,  we  will  use  the  term  BOCES. 
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Objectives 

Three  purposes  guide  this  report.     The  first  is  related  to  testing 
an  analytical  framework  for  describing  formal  policies  that  govern  or  in- 
fluence KPU.     This  framework  is  described  in  the  main  volume  of  this  study. 

The  second  purpose  is  substantive.    How  are  BOCES  generally  governed? 
What  formal  policies  are  most  important?    In  particular,  what  are  the  poli- 
cies that  encourage  or  discourage  BOCES  in  carrying  out  KPU?  Discussion 
of  BOCES  formal  policy  must  consider  policies  that  affect  a  BOCES  from 
outside  the  organization  itself,  and  internal  BOCES  policies  that  guide 
the  selection  and  operation  of  KPU  activities.     Thus,  we  have  two  formal 
objectives: 

(1)  To  show  where  BOCES  fit  into  the  education  governance 
structure  of  the  state  as  called  out  by  formal  policies. 

(2)  To  describe  the  operation  of  KPU  activities  within  a 
BOCES  according  to  formal  policy. 

We  selected  a  specific  BOCES  in  each  state  to  satisfy  the  second  objective; 
these  are  (1)  the  Nassau  County  BOCES  in  Westbury  (Long  Island),  New  York, 
and  (2)  the  Northern  Colorado  Educational  BOCS  in  Longmont,  Colorado.  Our 
rationale  for  selecting  these  particular  BOCES  for  analysis  is  discussed 
later  in  this  report. 

Finally,  this  analysis  is  intended  to  be  useful  to  policjmiakers  and 
educational  administrators  alike.    For  agencies  that  fund  and  otherwise 
support  KPU  at  state,  regional,  and  local  levels,  what  are  the  p^licieis 
to  which  these  groups  should  be  most  sensitive?     Can  such  information 
help  in  improving  communication  between  local  education  agencies  that  have 
special  needs  and  federal  or  private  education  agencies  that  administer 
resources  for  KPU?    Do  the  important  policies  indicate  key .agents,  within 
the  BOCES  system  who  play  major  roles  in  governing  or  influencing  KPU? 
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For  administrators  and  policymakers  in  states  without  RESA-type  agencies, 
does  this  report  provide  adequate  information  for  assessing  the  potential 
structure  and  governance  of  a  similar  organization  within  -their  own  areas? 
Does  such  a  description  help  in  comparing  the  governance  structures  sur- 
rounding different  kinds  of  ISAs? 

Background 

What  Are  BOCES? 

The  BOCES  concept  was  first  institutionalized  in  New  York  in  1948. 
During  the  past  25  years  a  number  of  other  states  have  adopted  the  con- 
cepts underlying  the  New  York  system,  altering  them  where  necessary  to 

-  t 

fit  their  own  needs  and  state  education  systems.  The  main  characteristics 
of  BOCES  are  the  following: 

•  BOCES  are  voluntary  organizations;  local  education  agencies 
(LEAs)  form  or  join  a  BOCES  voluntarily. 

•  BOCES  are,  in  part,  locally  governed;  other  governance  not- 
withstanding, they  can  do  nothing  that  does  not  solicit  the 
participation  of  some  of  their  memjber  districts. 

•  BOCES  are,   at  least  in  part,  locally  financed. 

The  main  purpose  of  a  BOCES  is  to  foster  and  permit  coopera- 
tion in  education  with  a  given  geographical  region  without 
consolidating  smaller  districts  into  larger  agencies. 

The  term  BOCES  has  three  legal  meanings;     (1)  the  organization  that  car- 
ries on  cooperative  activities,    (2)  the  governing  board  of  that  organiza- 
tion,  and  (3)  a  geographical  region  served  by  the  cooperative.  Here, 
however,  we  will  use  the  term  BOCES  when  referring  to  the  organization 
as  a  whole,  and  BOCES  board  when  referring  to  the  governing  body.  Except 
for  one  instance  in  the  New  York  BOCES  discussion,  we  will  not  use  BOCES 
in  the  geographical  sense. 
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Why  New  York  and  Colorado? 

Colorado  and  New  York  were  selected  for  this  analysis  for  a  number 
of  reasons. 

First,  BOCES  are  pervasive  institutions  in  both  states.     In  New  York, 
all  but  22  school  districts  are  members  of  one  or  another  of  the  state's 
46  BOCES.     Of  these,   only  the  five  largest  urban  school  districts  are  for- 
bidden by  law  from  forming  or  joining  a  BOCES.     In  Colorado,  there  are 
now  17'  BOCS,   the  maximum  number  permitted  by  state  law,   and  170  of  the 
state's  181  districts  belong  to  a  BOCS. 

Second,  while  the  organization  of  BOCES  is  similar  in  both  states, 
the  age  and  history  of  BOCES  operation  are  quite  different.     BOCES  were 
formally  authorized  in  New  York  in  1948,  mainly  as  a  cooperative  aid  for 
poorer  rural  districts.     Supervisory  districts,  however,  preceded  BOCES, 
and  the  BOCES  system  was  an  attempt  to  reorganize  and  improve  this  earlier 
form  of  regionalism.     BOCS  in  Colorado  were  formed  in  1965  under  statewide 
legislation.     During  the  prior  two  decades,  Colorado's  education  system 
had  undergone  a  consolidation  that  reduced  the  number  of  districts  from 
more  than  2000  in  1935  to  181  in  1964  (Brubacher,  1975);  BOCS  was  an  ef- 
fort to  provide  educational  services  to  districts  at  a  reasonable  cost, 
while  preserving  the  strong  local  autonomy  of  education  that  is  prescribed 
by  Colorado's  state  constitution. 

Third,  there  are  important  similarities  between  the  BOCES  operation 
in  both  states.     Membership  is  voluntary  in  both  New  York  and  Colorado; 
neither  BOCES  system  has  the  power  to  tax;  and  local  district  control  is 
an  important  policy  in  both  states. 

Finally,  the  overall  organization  of  the  state  education  systems  of 
New  York  and  Colorado  is  different.     New  York's  system  is  highly  .central- 
ized; Colorado's  is  decentralized.     In  New  York,  several  actors  in  the 
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SEA  have  powerful  formal  roles  ia  governing  education.     In  Colorado,  the 
key  agencies  responsible  for  governance  are  the  local  boards  of  education 
(LBEs). 

In  each  stjate,  as  noted  above,  we  have  looked  only  at  internal  KPU 
policy  for  one  BOCES.     The  reason  for  such  selectivity  was  a  requirement 
to  test  the  descriptive  powers  of  the  analytical  framework,  rather  than 
an  intent  to  compare  and  contrast  the  KPU  policies  of  all  BOCES  in  both 
states.     In  general,  we  looked  at  the  BOCES  with  the  strongest  KPU  in- 
volvement in  each  state  as  identified  by  knowledgeable  correspondents. 
(In  Colorado,  however,  we  deviated  slightly  from  this  approach;  at  the 
suggestion  of  a  Colorado  SEA  officer,  we  looked  briefly  at  the  organiza- 
tion and  major  policies  of  another  BOCS,   one  not  heavily  involved  in  KPU. 
This  was  the  Weld  County  BOCS  in  LaSalle.     We  wanted  to  know  how  policies 
of  that  BOCS  might  have  encouraged  activities  other  than  KPU.) 

Summary  of  Conclusions 

Despite  a  great  many  apparent  similarities  between  the  New  York  and 
the  Colorado  systems,   there  are  important  differences  in  how  they  are 
governed.     Formal  policies,  especially  the  respective  state  education 
codes,  are  explicit  about  governance. 

Issues  in  Governance 

Local  control  of  BOCES  activity  is,   in  policy  and  in  fact,   the  domi- 
nant concern  in  both  states;  in  Colorado,   it  is  the  only  concern.     In  New 
York,  however,  the  BOCES  are  the  middle  level  of  a  three-tier  education 
system;  as  such,   they  are  an  important  formal  and  actual  link  between  the 


The  formal  policies--laws,  regulations,  SOPs,  and  so  forth — that  specify 
governance  systems  are  cited  in  the  respective  state  descriptions. 
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local  school  districts  and  the  Snate  Education  Department,     To  be  initiated, 
proposed  BOCES  programs  first  must  be  responsive  to  the  needs  of  more  than 
one  member  LEA,   second  must  be.  reviewed  by  the  Bureau  of  School  District 
Organization  of  the  State  Education  Department,  and  third  must  elicit  par- 
ticipation by  more  than  one  BOCES  LEA.     The  executive  officer  of  a  New 
York  BOCES  is  also  an  employee  of  the  state  system;  he  has  important  non- 
BOCES  responsibilities  and  is  a  key  actor  in  connecting  the  state  educa- 
tion system  with  both  the  BOCES  and  the  local  districts  that  he  assists 
or  manages. 


In  Colorado,  on  the  other  hand,   the  BOCS  system  has  only  two  levels^ 
the  intermediate  agency  itself  .and  its  member  LEAs.     Governance  rests  with 
the  member  LBEs,  which  act,  in  part,   through  a  BOCS  governing  board;  BOCS 
programs  can  be  mounted  if  at  least  one  member  LEA  chooses  to  participate. 
The  program  selection  process  is  entirely  limited  to  the  two  levels; 
through  a  sequence  of  internal  reviews  the  BOCS  establishment  selects  pro- 
grams, and  member  LEAs  choose  whether  or  not  to  participate.     The  BOCS 
executive  officer  is  an  appointee  of  the  governing  board  and  manages  the 
BOCS  for  that  body.     The  Colorado  Department  of  Education  does  interact 
with  the  BOCS  system,  but  only  by  disbursing  an  annual  state  grant  to  each 
BOCS  and  by  providing  "consultative  assistance"  to  the  BOCS. 

Fiscal  Policy 

Both  BOCES  systems  are  partially  funded  by  their  member  districts, 
but  the  funding  mechanisms  work  differently.     In  New  York,  BOCES.  expenses 
are ^ divided  into  administrative  costs  and  program  costs.  Administrative 
costs  are  shared  by  all  the  member  LEAs  according  to  one  of  two  formulas, 
BOCES  programs  for  member  LEAs  are  paid  pro  rata  by  those  LEAs  that  par- 
ticipate;  for  programs  that  have  been  previously  approved  by  the  State 
Education  Department,   the  state  reimburses  the  participating  LEAs  for  ap- 
proximately 60%  of  their  cost. 
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In  Colorado^   as  in  New  York,   the  LEAs  that  participate  in  BOCS  pro- 
grams pay  the  costs.    However,  the  state  does  not  reimburse  the  local 
districts  in  any  way;  rather,   the  state  pays  each  BOCS  an  annual  grant 
of  $10,000  for  administrative  expenses.     The  BOCS  governing  board  may 
assess  member  LEAs  dues  according  to  one  of  several  available  formulas; 
these  dues  go  mostly  for  covering  administrative  expenses. 

Both  BOCES  systems  may  contract  with  outside  agencies;  grants  from 
agencies  like  NIE,  USOE,  and  private  foundations  are  particularly  impor- 
tant sources  of  income  for  KPU  activity.     In  general,  programs  are  begun 
with  a  mix  of  funding  sources  and  continued,   if  successful,  with  member 
LEA  support.     Both  BOCES  may  sell  services  and  goods  to  non- BOCES  agencies 
the  authorizing  policy  is  similar  in  both  states,  but  Colorado  legislation 
permits  interaction  of  this  sort  with  other  SEAs,  while  New  York  policy 
is  unclear. 

KPU  Policy 

In  neither  state  is  KPU  policy  highlighted  for  the  BQCES.     To  a  great 
extent,  both  BOCES  have  the  same  legal  status  as  LEAs  (although  without 
the  power  to  tax  or  commit  local  resources).     Scattered  through  the  re- 
spective state  education  codes  are  KPU  activities  that  the  BOCES  are  per- 
mitted to  undertake  as  BOCES  or  as  LEAs — i,e,,   providing  media  services, 
in-service  education,  and  so  forth.     For  both  Colorado  and  New  York  BOCES, 
any  activities  that  are  selected  by  member  LEAs  (and  in  New  York,  approved 
by  the  Bureau  of  School  District  Organization)  and  that  are  not  contrary 
to  other  state  policies  are  permitted. 

Both  BOCES  play  an  important  role  in  assisting  their  member  LEAs  with 
needs  assessment,  so  that  many  KPU  programs  should  be  considered  to  be  a 
result  of  both  local  district  interest  and  the  joint  processes  of  needs 
identification  and  program  design. 
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Summary  of  Recommendations 

We  make  two  kinds  of  recommendations:     those  for  further  studies, and 
those  for  better  coordinating  KPU  between  the  BOCES  systems  and  the  fed- 
eral education  establishment.     Here  we  only  outline  our  recommendations; 
the  rationale  for  and  a  discussion  of  each  recommendation  are  included 
in  the  final  section  of  this  paper. 


Further  Studies 

(1)  Formal  policy  mechanisms  for  KPU  in  ISAs  is  a  study  that 
looks  mainly  at  policies  governing  how  the  BOCES  select 
and  conduct  programs  and  how  they  are  funded.  Other 
studies,  notably  Stephens  (1975),  review  state  policy  at 

a  highly  aggregated  level.     A  study  that  explicates  selec- 
tion and  fiscal  policy  of  other  ISAs  should  be  considered 
as  part  of  a  program  to  improve  interaction  in  KPU  be- 
tween federal  and  locaL.  agencies, 

(2)  This  study,  in  looking  only  at  formal  governance,  does 
not  make  clear  why  some  ISAs  emphasize  KPU  while  others 
do  not,  other  than  to  note  that  local  concerns  govern 
the  BOCES,     A  review  of  program  history  across  all  the 
individual*  BOCES — in  Colorado,   in  New  York,   and  in  other 
states  with  similarly  organized  ISAs— should  be  considered 
as  one  means  of  understanding  local  priorities,, 

(3)  More  detailed  studies  of  ISA  governance  may  or  may  not  be 
useful.     Member  LEA  policy  that  guides  BOCES  operation 
may  provide  important  clues  for  encouraging  KPU  at  the 
local  or  intermediate  level,  but  we  believe  the  costs  of 
carrying  out  such  detailed  research  might  well  be  more 
than  the  benefits  of  having  such  information, 

(4)  This  research  was  limited  to  formal  policy.    More  informal 
criteria  for  decision  making  (e,g,,  the  political  context 
of  education  at  the  local  level,  the  abilities  of  key  ac- 
tors, local  economic  conditions ,  and  so  forth)  appear  at 
least  as  important  as  formal  rules  for  governance**  Thus, 

a  study  that  identifies  the  relationships  between  decision 
making  criteria--both  formal  and  informal— and  the  amount 
of  participation  in  KPU  should  produce  more  useful  re- 
sults, -.  -  ■ 
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KPU  Monitoring  and  Policy 

(1)  Although  for  different  reasons,   a  single  agency  in  each 
state  appears  to  be  a  nexus  for  information  about  BOCES 
activities.     These  are  (1)  Regional  Field  Coordinators 
Unit  in  Colorado  and  (2)  the  Bureau  of  School  District 
Organization  in  New  York.     NIE  should  consider  develop- 
ing a  close  working  relationship  with  both  agencies  to 
(1)  collect  information  about  the  history  of  KPU  activ- 
ity in  that  state's  ISA,   (2)  gain  knowledge  about  local 
interests  and  local  needs  for  KPU  as  expressed  through 
the  BOCES  system,  and  (3)  provide  comprehensive  infor- 
mation about  ongoing  and  anticipated  NIE  ventures  to 
encourage  KPU,  especially  dissemination,  at  the  local 
and  intermediate  levels. 

(2)  The  BOCES  systems  in  both  states  should  consider  en- 
couraging informal  networks-- i. e. ,  "invisible  college s"-- 
through  which  separate  ISAs  and  local  districts  might 
share  information  about  endogenous  programs  and  needs, 
and  exogenous  resources.     The  two  agencies  discussed 
above  are  ideally  located  in  the  organization  structure 
for  managing  such  a  network. 

(3)  While  this  study  does  not  look  at  all  the  BOCES  or  the 
details  of  RESA/ISA  governance  in  other  states,   our  find- 
ings do  indicate  that  both  BOCES  systems  work  quite  well 
in  meeting  their  main  purpose,  i.e.,  regional  cooperation. 
As  at  least  partial  successes,   they  should  be  considered 
as  potential  models  for  other  states  contemplating  the 
development  of  ISAs.     A  detailed  description  of  the  gov- 
ernance structure,  such  as  presented  here,  should  provide 
more  than  adequate  information  about  organization  and 
management  for  alternative  models. 

(4)  Both  formal  policy  and  respondents  for  this  study  indi- 
cated that  the  BOCES  concept  has  played  a  major  role  in 
creating  a  favorable  climate  for  cooperative  needs  assess- 

^ment  and,   to  a  lesser  extent,  program  evaluation.  The 
formal  policy  mechanisms  that  prescribe  such  activities 
may  provide  good  models  for  other  agencies  wishing  to  in- 
fuse planning  and  evaluation  into  their  own  organization 
structures. 

(5)  Finally,  the  BOCES  we  looked  at  closely  appeared  to  have 
successfully  extended  programs  through  a  variety  of  fund- 
ing mechanisms  after  initial  federal  funds  had  ceased. 
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Since  member  LEA  approval  is,  to  varying  degrees,  nec- 
essary for  such  continuation  in  both  states,  we  believe 
the  BOCES  may  provide  good  models  of  organizations  that 
initiate  innovation  and  operate  sufficiently  well  to  en- 
courage their  members  to  continue  funding  exemplary  pro- 
grams . 
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II    COLORADO:     BOARDS  OF  COOPERATIVE  SERVICES  (BOCS) 
Overview  of  Policy  Relationships  for  Colorado  BOCS 


The  BOCS  system  in  Colorado  was  established  by  the  Board  of  Coopera- 
tive Services  Act  of  1965;  as  amended  in  1973,  the  Act  authorized  17  BOCS 
eligible  for  state  funding.     There  are  now  that  many  in  existence.*  Two 
major  policy  sets  govern  the  operation  of  a  BOCS:     (1)  the  1965  Act,  as 
amended  in  1973,  and  (2)  policies  of  the  BOCS  governing  board.     To  the 
extent  that  they  choose  to  interact  with  other  education  agencies  within 
and  without  Colorado,  BOCS  must  be  responsive  to  other  guidelines.  Two 
other  Colorado  education  agencies  play  a  role  in  BOCS  operation,  although 
almost  entirely  in  an  advisory  capacity.     They  are  the  Office  of  Regional 
Field  Service  Coordinators  of  the  Colorado  Department  of , Education  and  a 
quasi-official  organization  called  the  Colorado  BOCS  Association. 

Figure  VIII-1  shows  the  major  agencies  that  govern  or  influence  BOCS 
Table  VIII-6  briefly  outlines  the  main  policy  relationships  among  them. 

Major  Policies  from  Outside  the  BOCS 

In  Colorado,   local  control  of  public  education  (K-12)  is  mandated  by 
the  Colorado  State  Constitution: 

The  general  assembly  shall,  by  law,  provide  for  organization 
of  school  districts  of  convenient  size,  in  each  of  which  shall 
be  established  a  board  of  education,  to  consist  of  three  or 
more  directors  to  be  elected  by  the  qualified  electors  of  the 


The  1965  Act  makes  no  restriction  pn  the  actual  number  of  cooperatives; 
consequently,  BOCS  may  be  established  that  are  not  eligible  for  state 
funding.     However,  we  will  not  discuss  these  kinds  of  BOCS;  in  general, 
their  governance  would  be  much  the  same  as  the  funded  BOCS. 
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"Focus  of  Analysis' 


Note:  Circled  numbers  denote  policy  relationships;  these  are  outlined  in  Table  VI 1 1-6. 


FIGURE  Vill  i    COLORADO  BOGS  AND  MAJOR  POLICY  RELATIONSHIPS 
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Table  VIIl-6 

KEY  AGENCIES  AND  POLICY  RELATIONSHIPS  IN  THE  BOCS  SYSTEM* 


,  Pollcv  Setting  A^ent. 

1  Policy  Implement  I  njj  Ajtent 

Re  lationship 

I  • 

1  State  Legislature 

'State  Board  ot  Education 
i  (SBE) 
State  Department  of 
Education  (SDE) 
[The  SDE  is  effectively 
the  staff  of  the  SBE.  ] 

The  Colorado  State  Legislature  makes  law  for  the  SBE^-the  most  im- 
portant state-level  education  agency<-and  the  SDE.     The  most 
important  law  affecting  BOCS  is  the  1963  BOCS  Act,  as  amended. 
Both  agencies  play  a  role  In  setting  up  and  administering  certain 
statewide  educational  programs,  none  of  which  is  KPU. 

2 

SBE 

SDE 

Legally,  the  SBE  governs  the  SDE.     The  SBE  appoints  Colorado's  Com- 
missioner of  Education,  who  administers  the  SDE. 

3 

BOCS  directors 
Regional  field 

service 

coordinators 

Colorado  BOCS 
Association 

The  Association  is  a  group  whose  membership  is  open  to  the  direc- 
tors of  the  17  BOCS,  BOCS  staff,  school  board  members,  and 
superintendents.     For  the  most  part,  the  Association  is  a  place 
where  members  can  exchange  information  and  work  out  mutual  prob- 
lems.     The  regional  field  service  coordinators  of  the  SDE 
participate  actively  in  Association  activities.     The  Association 
has  no  formal  role  in  Colorado's  education  system,  but  is  probably 
a  major  source  of  informal  information  exchange  among  the  BOCS. 

A 

Office  of  Field 
Services  (SDE) 

BOCS  (not  a  governance 
link  per  se) 

The  Office  of  Field  Services  maintains  close  relationships  with  the 
17  BOCS  through  five  regional  field  service  coordinatorc.  These 
people  provide  mostly  consultative  assistance  to  the  BOCS;  they,  in 
no  way,  govern  BOCS.     The  only  formal  role  for  the  SDE  — through  the 
Office  of  Field  Services--is  to  certify  each  year  to  the  SBE  the  17 
eligible  for  the  $10,000  grant. 

5 

Associate  BOCS 
members 

BOCS  board 

Certain  education  agencies,  mostly  community  colleges,  state  col- 
leges, and  universities,  may  belong  to  a  BOCS  as  associate  members. 
They  participate  in  BOCS  activities  when  they  so  elect,  and  are 
nonvoting  members  of  the  governing  board. 

6 

Member  LBEs 

BOCS  governing  board 

The  BOCS  governing  board  is  made  up  of  one  member  from  each  of  the 
member  districts.    These  members  are  elected  by  their  respective 
LBEs.     This  membership  provides  the  main  (and  only  legal)  link  be- 
tween member  districts  and  the  BOCS  Itself.     It  is  also,  in  fact, 
the  main  mechanism  that  ensures  local  control  over  BOCS. 

7 

Member  L£As 

BOCS  advisory  council 

Professional  education  administrators  from  the  member  LEAs  provide 
advice  for  both  the  BOCS  governing  board  and  the  BOCS  director 
through  an  advliory  council.    The  makeup  and  formal  activities  of 
this  group  are  determined  by  the  BOCS  bylaws. 

8 

BOCS  governing  board 

BOCS  director 
BOCS  organization 

The  BOCS  governing  board  has  legal  authority  over  the  operation  of 
a  BOCS  (see  number  6  above).     Besides  acting  as  the  formal  BOCS 
agency  — the  board  is  the  BOCS--the  board  appoints  the  BOCS  director 
and.  either  approves  or  disapproves  all  propoied  BOCS  activities. 

9 

BOCS  advisory 
council 

BOCS 

The  advisory  council  advises  the  governing  board  and  the  BOCS  di- 
rector (fee  number  7  above). 

LO 

Menibers  LBEs 

BOCS 

Member  districts  choose  whether  or  not  to  participate  in  any  given 
BOCS  program. 

LI 

Federal  education 
agencies 

SDE 

BOCS 

LEAs 

Various  federal  education  agencies  (mainly  NIE  and  USOE)  provide 
guidelines  to  the  SDE  and  the  LEAs  regarding  participation  in 
federally  funded  programs.     From  the  federal  perspective,  BOCS  it 
an  LEA.     Where  the  SDE  or  LEAs  choose  to  participate,  they  must 
comply  with  those  formal  policies  promulgated  by  the  federal 
agencies. 

12 

Other  SEAt  (outside 

Colorado) 
Private  agencies 
Jion-BOCS  LEAs 

BOCS 

BOCS  can  interact  with  other  educational  agencies,  both  within  and 
without  the  State  of  Colorado.    When  they  do  this,  the  formal  re- 
lationship is  contractual,  and  Lhote  formal  policies  (of  other 
states  and  other  Colorado  agencies)  that  govern  contract!  are 
important. 

Policies  that  prescribe  these  relationships  are  cited  in  text. 


Numbers  refer  to  circled  numbers  in  Figure  VIII-1. 
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district.     Said  directors  shall  have  control  of  instruction 
in  the  public  schools  of  their  respective  districts  (§15, 
Article  IX). 

Neither  the  general  assembly  nor  the  state  board  of  education 
shall  have  the  power  to  prescribe  textbooks  to  be  used  in  the 
public  schools  (§16,  Article  IX). 

The  17  Colorado  BOGS  are  organized  and  operated  within  the  context  of  for- 
mally mandated  local  control. 

The  most  important  policies,  outside  the  BOGS  themselves ,  ..that  regu- 
late or  influence  the  BOGS  are  few.     They  are: 

•  The  Golorado  Board  of  Gooperative  Services  Act  of  1965,  as 
amended  (Article  5,  State  Education  Gode) . 

•  The  Golorado  "Gontracting  Law"   (§23  of  123-30  G.R.S."'  1965, 
as  amended).  ^ 

•  Gertain  other  sections  of  the  State  Education  Gode  that  pre- 
scribe the  purposes,  powers,  rights,  obligations,  and 
responsibilities,  financial  or  otherwise,  of  school  district 
boards. 

Other  policies  that  may  importantly  influence  but  that  do  not  regulate 
BOGS  Include: 

•  Federal  and  state  policies  that  govern  the  availability 
of  money  for  educational  programs  in  general,  and  KPU  in 
particular.    Of  importance  to  BOGS  KPU  activities  are  ESEA 
Title  III  funds  and  guidelines.     Emerging  NIE  policy  that 
governs  the  distribution  of  KPU  and  other  funds  to  states 
and  LEAs  should  be  considered  similarly  important. 

•  Policy  guidelines  for  Golorado 's  Regional  Field  Goordinators 
Unit.  —J'" 

•  Policies  of  other  organizations  that  may  participate  with  a 
BOGS  in  various  KPU  projects.     Included  here  are  private 
educational  institutions  iri  Golorado,  Golorado*s  state 


Golorado  Revised  Statutes. 
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university  and  colleges,  community  colleges,  various  profit 
and  nonprofit  organizations,  and  education  agencies  outside 
the  State  of  Colorado  that  contract  with  a  BOCS  to  partici- 
pate in  a  particular  program 

Since  the  first  concern  for  a  BOCS  is  local  needs,  the  influence  of  this 
second  group  of  policies  is  indirect.     The  Regional  Field  Coordinators 
Unit,  for  example,  provides  continuing  assistance  to  the  BOCS,  but  does 
not  control  their  activities.     The  importance  of  the  other  policies  in 
this  group  depends  mostly  on  the  internal  policies  of  each  BOCS,  especially 
those  that  govern  the  selection  of  that  BOCS'  activities. 

•  In  addition,  the  informal  policies  of  the  Colorado  BOCS  Asso- 
ciations-more an  organization  for  collective  problem  solving 
and  information  sharing  than  a  policymaking  body--can  indirectly 
influence  BOCS  activity. 

The  most  directly  relevant  formal  policies  governing  BOCS  are  those 
promulgated  by  each  BOCS'  governing  board;  these  will  be  discussed  in  the 
section  on  the  Northern  Colorado  Educationral  BOCS. 

The  1965  BOCS  Act--How  the  BOCS  Are  Organized 

The  BOCS  Act  of  1965,  as  amended  in  1973  (Article  5,  State  Education 
Code)  is  the  principal  state  law  governing  the  formation  and  basic  opera- 
tion of  a  BOCS.     The  overall  purpose  of  the  Act  is  to  enable  two  or 
more  school  districts  to  cooperate  in  furnishing  services  authorized  by 
law  if  cooperation  appears  desirable"  (§22-5-102). 

BOCS  formed  under  the  provisions  of  this  Act  must  have  met  the  fol- 
lowing criteria  to  be  eligible  for  state  funding: 

•  It  (a  BOCS)  shall  serve  school  districts  with  a  combined  total 
enrollment  of  not  less  than  four  thousand  students. 

•  It  shall  serve  school  districts  in  two  or  more  counties. 
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•    It  shall  serve  school  districts  with  a  combined  total  valu- 
ation for  assessment  of  not  less  than  sixty  million  dollars 
or  school  districts  with  a  combined  total  area^or  not  less 
than  four  thousand  square  miles.     [ ( §22-5-114-2(a-c) ] 

BOGS  were  formed  by  application  of  two  or  more  school  districts 
desiring  such  an  organization  and  satisfying  the  above  criteria  to  the 
SBE.     The  SEE  can  either  approve  or  disapprove  such  an  application  (§22- 
5-104). 

Organizations  other  than  school  districts  may  join  a  BOGS  as  associate 
members;  these  include  community  and  technical  colleges,  junior  college 
districts,  and  state-supported  institutions  of  higher  learning.  Approval 
of  such  memberships,  and  of  memberships  of  any  additional  school  districts, 
is  at  the  discretion  of  the  BOGS  governing  board  (§22-5-104-3). 

The  governing  board  is  designated  in  the  1965  Act  as  the  formal  con- 
trolling and  policy  setting  agency  for  each  BOGS.     A  board  has  no  fewer 
than  five  members;  however,  each  participating  school  district  must  be 
represented  on  the  board.     The  individual  members  of  the  board  are  ap- 
pointed by  their  respective  LBEs;  each  is  an  LBE  board  member  whose  term 
of  membership  on  the  BOGS  board  coincides  with  his  term  as  an  LBE  director. 
The  BOGS  board  must  meet  at  least  quarterly.    Alternate  members--f rom  the 
participating  LBE--may  take  the  place  of  regular  board  members  who  are 
absent.     A  quorum  consists  of  a  simple  majority  of  board  members  (§22-5- 
104-2,4).  .  • 

Responsibilities  of  the  BOGS  Board 

The  main  responsibility  of  the  BOGS  board  is  to  adopt  a  set  of  bylaws 
that  establish  the  BOGS  as  a  legal  entity  meeting  the  state  requirements, 
and  to  govern  the  BOGS.     In  general,  the  powers  of  a  BOGS  board  are  the 
same  as  those  of  an  LBE;  there  are  several  exceptions,  however,  the  most 
important  being  that  the  BOGS  board  does  not  have  the  power  to  tax  or 
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commit  local  resources.    A  number  of  KPU-related  activities  discussed  in 
the  State  Education  Code  fall  within  the  domain  of  BOGS  as  well  as  that 
of  the  LEAs;  in  fact,  it  is  convenient  to  think  of  a  BOGS  as  a  limited 
LEA.     These  responsibilities  include: 

(1)  To  adopt  written  policies,  rules,  and  regulations,  not 
inconsistent  with  law,  which  may  relate  to  . . .  in-service 
training,  professional  growth  ...  of  employees  ( §22-32-110-k) . 

(2)  To  provide  . . .  out  of  federal  funds  made  available  specific- 
ally for  this  purpose,  library  resources  which,  for  the 
purpose  of  -this  title,  mean  books,  periodicals,  documents, 
magnetic  tapes,  films,  phonograph  records,  and  other  related 
library  materials  and  printed  and  published  instructional 
materials  for  the  use  and  benefit  of  all  children  in  the 
district  and  the  use  of  teachers  to  benefit  all  children 

in  the  district,  both  in  the  public  and  nonpublic  schools 
(§22-32-110-dd). 

There  is  no  specific  inclusion,  exclusion,  or  discussion  of  R&D  (i.e., 
KPU)  per  se  in  this  section  of  the  Education  Gode. 

Finally,  the  board  appoints  an  executive  director  who  administers  the 
BOGS  for  the  board. 


Responsibilities  of  the  SBE  and  SDE 

The  major  responsibilities  of  the  SBE--and  consequently  the  SDE  — 
include  several  activities  that  affect  the  BOGS,  namely: 

(1)  Governing  all  education  programs  in  the  SDE  for  K-12 
students  [§123-l-7(d)  G.R.S.  1965,  as  amended].     This  • 
refers  to  education  programs  operated  by  the  SDE,  not  to 
those  operated  by  local  districts. 

(2)  Providing  consultative  services  to  the  public  schools  and 
boards  of  education  of  school  districts  [ §123-1-7 (g)  G.R.S. 
1965,  as  amended]; BOGS,  as  LEAs,  are  also  eligible  for  * 
consultative  services.     The  Regional  Field  Goordinators 
Unit  of  the  SDE's  Office  of  Field  Services  provides  these 
services  for  BOGS. 
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(3)  Certifying  the  eligibility  of  each  BOCS,  up  to  17,  for  the 
state  grant  of  $10,000  each  year,  and  paying  that  amount 
to  eligible  BOCS  (§22-5-115  Ed.  Code);  the  Regional  Field 
Coordinators  Unit  also  performs  this  task. 

(4)  Coordinating  federal  programs  in  education  not  directed 
toward  another  agency  within  the  state  [ §123-1-7 (j)  C.R.S. 
1965,  as  amended] --for  example,  ESEA  Title  III  and  NDEA 
Title  III. 

(5)  Cooperating  with  other  agencies  within  and  without  the 
state  for  the  improvement  of  education  [ §123-1-7 (m)  C . R. S . 
1965,  as  amended]. 

Thus,   the  key  formal  interactions  between  the  SBE/SDE  complex  and  a 
BOCS  are  characterized  by  "consultation"  and  "cooperation."    The  actual 
governance  of  BOCS  is  left  to  the  member  LBEs,  the  BOCS  board  representing 
the  members,  and  the  board's  appointed  administrator. 

Finally,   the  SDE  is  responsible  for  accepting,  using,  disbursing,  ♦  and 
administering  all  federal  aid  allotted  to  the  State  Board  of  Education  . 
for  "...  local  public  schools  or  public  educational  functions  ..."  [§123- 
1-7(12)  C.R.S.   1965,  as  amended].     Various  offices  within  the  SDE  adminis- 
ter whatever  federal  funds  may  be  available  to  a  BOCS  through  programs  in 
which  the  BOCS  elects  to  participate.     This  is  only  true,  of  course,  for 
federal  funds  that  funnel  through  the  state;  some  federal  funds  are  avail- 
able directly  to  an  LEA  without  the  SDE  acting  as  an  intermediary  (e.g., 
NIE's  local  problem  solving  program). 

Other  Important  Policy 

The  Contracting  Law 

Colorado's  "Contracting  Law"  further  ensures  local  autonomy  and,  by 
extension  of  certain  of  the  powers  of  local  boards,  permits  BOCS  to  inter- 
act with  many  other  kinds  of  agencies  (§23  of  123-30  C.R.S.   1965,  as 
amended).     Brubacher  (1975,  p.   2)  notes  that  the  law  permits  local  dis- 
tricts to  make  contracts  with  any  state  college  or  university;  atiy  tribal 
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corporation  of  any  Indian  tribe  or  nation;  any  federal  agency  or  officer; 
any  county,  city,  or  city  and  county;  any  natural  person;  and  any  corporate 
body  or  association. 

Regional  Field  Coordinators  Unit 

The  Regional  Field  Coordinators  Unit  of  the  SDE  provides,  as  noted 
above,  assistance  to  the  BOCS.     Formal  policy  for  that  unit  is  prepared 
on  an  annual  basis.     Under  the  requirements  of  §22-2-106 (1) (a)  of  the 
»  Education  Code  and  the  1965  BOCS  Act,  the  Unit's  present  policy  toward 
assistance  for  BOCS  includes: 

•  Provide  administrative  consultative  services  to  . . .  BOCS. 

•  Conduct  on-site  visits  to  each  ...  BOCS. 

•  Attend  and  participate  in  superintendents*  advisory  council 
meetings  and  board  meetings  of  BOCS. 

•  Coordinate  Colorado  BOCS  Association  activities. 

•  Disseminate  information  on  change,  and  share  methods,  tech- 
niques, and  policies  of  exemplary  programs  with  otjier  LEAs. 

•  Disseminate  information  on  state  and  federal  programs  and 
activities. 

•  Assist  . . .  BOCS  with  school  district  organization,  dissolu- 
tion, and  annexation;  detachments;  master  plans;  resolutions; 
bylaws;  constitutions. 

•  Certify  to  the  SBE  the  names  of  not  more  than  17  BOCS  for  the 
approval  of  payment  of  state  funds  as  provided  for  by  the 
BOCS  Act  of  1965,  as  amended. 

•  Monitor  state  payments  to  approved  BOCS. 

Thus,  the  Unit  is  the  key  state  agency  that  interacts  with  BOCS,  providing 
in  particular,  key  policy  and  information  dissemination  links  among  the 
federal  education  establishment,  other  state  agencies^  and  the  BOCS  system. 

The  Unit  is  made  up  of  five  individuals,  each  responsible  for  coor- 
dinating assistance  for  school  districts  and  BOCS  within  a  region  of  the 
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state.     The  coordinators  attend  BOGS  advisory  council  and  BOGS  board 
meetings  regularly;  they  also  coordinate  Golorado  BOGS  Association  acti- 
vities.    All  respondents  in  this  study  praised  the  work  of  this  unit  and 
its  effectiveness. 

Each  coordinator  provides  backup  for  the  others;  when  one  is  not 
available  to  give  assistance  to  his  assigned  BOGS,  another  is  available 
to  meet  the  needs.     In  addition,  each  coordinator  has  specific  areas  of 
responsibility,  e.g.,  school  district  organization  and  school  board 
policy . 


The  Operation  of  a  BOGS 

Four  key  actors  govern  a  BOGS:     the  member  LBEs,   the  BOGS  board,  the 
BOGS  executive  director,  and  a  BOGS,  advisory  committee  that  is  made  up  of 
educational  administrators  from  the  component  LEAs  and  that  advises  both 
the  board  and  the  executive  director.     The  BOGS  board  itself  is  the  rep- 
resentative of  the  member  LBEs  and  provides  one  channel  through  which  their 
needs  and  policies  are  felt. 

The  following  is  a  description  of  the  BOGS  governance  process  pub- 
lished by  the  SDE : 

...  With  the  absence  of  taxing  authority,  the  BOGS  exists  only 
at  the  discretion  of  its  member  school  districts.     The  lack  of 
power  to  commit  local  districts  causes  all  decisions  of  the  co- 
operative board  involving  the  utilization  of  local  school 
district  facilities ,  equipment,  staff,  or  finances  to  be  sub- 
mitted to  each  LBE  involved  for  ratification  before  the  decision 
is  final.  '      ,  ' 

. . .  the  organizational  structure  of  each  BOGS  includes  an 
advisory  council*     The  council  is  made  up  of  the  superintendents 
of  participating  school  districts.     The  role  of  the  council  is 
to  identify  educational  needs  and  recommend  to  the  board  of 
directors,  ways  and  means  of  meeting  the  needs. 
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Once  a  need-has  been  identified,  the  professional  staff  of  the 
BOGS,  working  with  people  at  the  local  level,  develops  alterna- 
tive plans  for  meeting  the  need.     The  plans  include  objectives 
to  be  met,  resources  required,  a  budget,  an  implementation 
schedule,  and  an  evaluation  component. 

In  most  instances  alternative  plans  are  developed,  thus  giving 
the  advisory  council  a  broader  view  of  the  possibilities.  When 
the  plans  are  completed,  the  executive  director  of  the  BOGS 
presents  them  to  the  advisory  council  for  consideration  at  one 
of  the  regular  monthly  meetings.    The  advisory  council  may  (1) 
veto  the  entire  project,  (2)  refer  the  project  back  to  the  BOGS* 
staff  for  revision  or  additional  planning,  or  (3)  recommend  it 
to  the  board  of  directors  for  approval.     Assuming  the  advisory 
council  approves  a  plan,  the  executive  director  presents  the 
plan  to  the  board  along  with  the  advisory  council's  recommen- 
dation at  the  next  meeting. 

The  directors  may  reject  the  proposal,  refer  it  back  any  prior 
level  for  revision  or  further  study,  or  approve  the  plan  and 
refer  it  to  local  boards  for  ratification. 

At  this  point,  LBEs  exercise  their  powers  of  autonomy.  A 
local  board  may  elect  not  to  ratify  the  decision  of  the  co- 
operative board  and  thus  hot  participate  in  the  program  under 
consideration,  or  they  may  elect  to  ratify  and  participate. 
After  the  local  boards  make  their  respective  decisions,  the 
program  is  adjusted  to  the  number  of  districts  that  have 
decided  to  participate.     The  program  is  then  implemented  with 
the  BOGS  performing  those  functions  outlined  in  the  plan. 
(Brubacher,  1975) 

Figure  VIII-2  is  a  flowchart  of  these  decision  activities.  While 
formal  policy  is  explicit  about  who  governs — the  member  LBEs  through  the 
BOGS  governing  board — the  BOGS  are  structured  and  operated  so  that  any 
one  of  the  four  key  agents  may  initiate  discussion  about  a  perceived  need 
and  a  proposed  solution.     The  BOGS  advisory  council  acts  as  an  important 
screening  m,echanism  for  proposals,  assisting  the  executive  director  in 
assessing  LEA  requirements  and  reviewing  proposals  for  meeting  those 
needs.     Still,  final  approval  rests  with  the  member  LBEs,  which  must  either 
agree  or  refuse  to  participate  in  and  fund  a  BOGS-approved  program. 
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Funding  Mechanisms 


As  noted  above,  each  BOGS  eligible  under  the  provisions  of  the  1965 
Act  receives  a  basic  grant  of  $10,000  each  year  from  the  state  (§22-5-115 
Ed..  Code).    Any  other  money  for  BOGS  operation  must  come  from  the  member 
districts  or  outside  sources.     Brubacher  (1975)  explains: 

...  the  responsibility  for  financing  the  BOGS'  operation  rests 
primarily  with  local  school  districts. 

...  expenditures  by  a  cooperative  board  will  be  in  two  areas, 
one  for  special  programs  and  the  other  for  administrative 
expenses.     The  implementation  for  programs  and  services  is 
contingent  upon  their  development  and  ratification  by  LBES 
and  subsequent  allocation  of  funds.     The  secondary  source  of 
funding  comes  from  federal  and  state  agency  grants  and  occa- 
sionally private  foundation  grants.     Since  the  priinary  source 
of  funds  is  the  participating  districts,  some  equitable  fomula 
for  proration  of  costs  must  be  determined.     This  formula  must 
be  worked  out  by  the  cooperative  board  and  approved  by  all 
local  member  boards  of  education.     There  are  several  bases  which 
are  being  used:     assessed  valuation,  pupil  membership,  pupil 
attendance,  and  flat  fees.     A  large  portion  of  the  administra- 
tive expense  is  overhead  cost,  which,  to  some  degree  taxes  the 
local  district  budgets.     In  1973,  the  Colorado  Genera-l  Assembly 
recognized  the  problem  and  provided  for  an  annual  appropriation 
of  ten  thousand  dollars  for  each  of  seventeen  BOGS, 

Because  each  BOGS  must  be  responsive  to  the  needs  of  its  member  dis- 
tricts, special  regional  concerns  dominate  what  a  given  BOGS  does. 
Consequently,  BOGS  funding  patterns  are  primarily  determined  by  two  fac- 
tors--the  needs  of  the  members  of  a  specific  BOGS  and  the  availability  of 
"soft**  money  from  federal,  state,  and  private  sources.     Since  BOGS  may 
contract  with  outside  agencies,  several  BOGS  sell  special  services  to 
other  BOGS,  pos tsecondary  institutions  within  Colorado,  and  other  SEAs 
outside  Colorado,     Some  BOGS,  on  the  other  hand,  may  not  feel  the  need 
to  sell  products  outside  the  BOGS  and  are  more  likely  to  be  supported  by 
local  funds. 
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KPU  Policy  in  General 

Because  there  are  no  state  mandates  for  BOGS  (other  than  those 
prescribing  organizational  structure),  formal  policy  that  states  an 
inclination  toward  KPU  is  difficult  to  find.     For  the  most  part,  the  only 
formal  policies  that  show  a  KPU  orientation  are  the  decisions  of  the  BOGS 
board  and  the  member  LEAs  in  selecting  programs  for  participation.  In- 
direct indicators  of  such  policy  include  program  histories  (if  maintained) 
and  the  fiscal  records  of  each  BOGS. 

An  apparent  lack  of  BOGS'  KPU  activity  does  not  necessarily  mean  that 
no  KPU  is  taking  place  within  the  BOGS.     Where  local  member  districts  pre- 
fer to  carry  on  KPU  without  BOGS  support,  the  BOGS  may  be  engaged  in 
entirely  different  activities.    However,  although  there  are  no  data  avail- 
able on  this,  SDE  sources  informally  estimate  that  some  407o  of  all  KPU  in 
Golorado  is  carried  out  in  BOGS* 

The  ability  of  a  BOGS  to  identify  sources  of  funds  that  support  KPU 
programs  of  potential  interest  to  its  member  LEAs  is  probably  a  key  factor 
in  the  success  of  BOGS,     Beyond  the  very  real  constraint  of  the  availabil- 
ity of  outside  funds,  the  single  most  important  policy  constraint  on  the 
ability  of  a  BOGS  to  use  outside  funds  is  the  willingness        one  or  more 
member  districts  to  participate  in  the  BOGS  program. 

KPU  Policy  in  One  BOGS--Northern  Golorado  Educational  BOGS  (NGEBOCS) 

-  "    No  general  statements  can  be  made  about  internal  policies  that  en- 
courage or  discourage  KPU  in  a  specific  BOGS.     The  variation  of  interest 
and  needs  is  simply  too  great,  and  money . factors  less  formal  than  the 
kinds  of  policies  we  study  here  affect  the  kinds  of  programs  that  a  BOGS 
carries  on.    However,  general  decision-making  policy  (Figure  VIII-2  above) 
and  BOGS  bylaws  and  administrative  manuals  can  give  some  indication  of 
the  environment  in  which  programs  are  initiated  and  carried  out. 
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The  Northern  Colorado  Educational  BOGS  (NCEBOCS)  in  Longmont, 
Colorado,  appears  prominently  in  the  literature  and  was,  as  well,  sug- 
gested by  respondents  as  a  Colorado  BOCS  deeply  engaged  in  KPU  activities. 
Formal  policy,  however,  gives  little  indication  why  this  is  so.  The 
NCEBOCS  Bylaws  set  up  the  BOCS  as  a  legal  agency,   thereby  meeting  the 
requirements  of  the  1965  Act;  the  Bylaws  do  emphasize  LBE  control  by  noting 
that  the  BOCS  "...  cannot  obligate  the  funds  of  any  member  school  district 
without  the  approval  of  the  individual  boards  of  education"  (§VII,  NCEBOCS 
Bylaws).     Administrative  policies  of  NCEBOCS  discuss  only  administrative 
matters,  saying  nothing  about  the  substantive  orientation  of  the  BOCS. 

Three  associate  members  of  NCEBOCS  participate  in  a  variety  of  KPU 
projects  currently  under  way:     the  University  of  Northern  Colorado  at 
Greeley,  Colorado  State  University  at  Fort  Collins,  and  the  University  of 
Colorado  at  Boulder. 

NCEBOCS  carries  on  a  number  of  KPU  projects  that  are  sources  of  income 
from  outside  the  BOCS.     For  example,  NCEBOCS  has  an  information  retrieval 
service  that  is  used  by  other  BOCS  and  SEAs.    Also  of  interest  are  KPU 
product  packages,  developed  by  BOCS  prof e'fesional  staff,  that  are  sold  to 
interested  educators  nationwide,  and  the  Colorado  State  Facilitator  Proj- 
ect (with  Title  III  funding)  that  serves  all  the  BOCS. 

One  interesting  aspect  of  NCEBOCS'  KPU  activity  is  that  the  BOCS  has 
been  able  to  carry  on  projects  long  after  initial  funding  sources  have 
dried  up.     In  part  this  is  due  to  the  member  districts'  continuing  satis- 
faction with  the  projects;  however,  the  ability  of  NCEBOCS  to  generate 
revenue  through  sales  should  be  considered  important.     Because  of  the  BOCS 
governance  structure,  the  sale  of  products  must  be  sanctioned  by  the  member 
LBEs. 
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Most  new  projects  in  NCEBOCS  appear  to  be  funded  by  outside  sources, 
rather  than  by  local  funds;  successful  programs  have  the  continued  support 
of  member  LEAs.     However,  one  respondent  pointed  out  that  information 
about  forthcoming  state  and  federal  programs  was  critical  to  the  continued 
growth  of  a  BOCS  so  involved  in  innovation.     Again^^  the  SDE  '  s  Regional 
Field  Coordinators  Unit  was  described  as  helpful  here,  but  the  respondent 
noted  that  close  informal  contact  with  federal  education  agencies  was 
necessary  to  meet  federal  proposal  deadlines,  and  so  forth. 

-This,  then,  is  a  BOCS  in  which  professional  staff  play  an  active  role 
both  in  assessing  the  needs  of  member  districts  and  in  pursuing  available 
program  funds  outside  the  BOCS  itself.     There  is  no  indication  that  the 
BOCS  supersedes  the  interests  of  its  governing  board  or  member  LBEs;  to 
the  contrary,  there  appears"  to  be  a  long  and  comfortable  relationship  be- 
tween these  agents,  with  a  strong  orientation  toward  education  innovation 
and  dissemination  activities.     There  are,  however,  no  indications  of  this 
direction  in  formal  policies  beyond  the  actual  selection  of  projects  by 
the  BOCS  board. 

Another  BOCS  in  Colorado — Weld  County 

To  assess  the  possibility  of  a  different  formal  policy  climate  leading 
to  a  different  BOCS  orientation,  we  looked  at  policies  that  governed  the 
Weld  County  Board  of  Cooperative  Educational  Services  (BOCES,''   in  LaSalle, 
Colorado.     The  Weld  BOCES,  while  geographically  adjacent  .to  NCJBOCS, 
carries  on  programs  that  heavily  reflect  an  orientation  toward  special 
education  for  the  handicapped,  bilingual  projects,  and  media  services  for 
member  districts.     Only  the  latter  can  be  considered  KPU  in  the  sense  that 
it  has  been  used  in  this  project. 
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Like  the  NCEBOCS--and  apparently  all  Colorado's  BOCS--the  issue  of 
local  control  is  strongly  emphasized.     In  this  BOGS,  however,  administra- 
tive policies  clearly  cite  the  special  education  orientation.    A  respondent 
indicated  that  these  policies  evolved  from  the  member  LEAs '  preception  of 
the  requirements  of  a  constituency  that  is  different,  both  politically  and 
demo  graphically,  from  that  of  NCEBOCS.     The  purpose  of  the  Weld  BOCES  is 
illuminating: 

The  Weld  BOCES  was  founded  first  to  provide  special  services 
for  children  in  smaller  districts  which  found  it  economically 
impossible  to  finance  complete  special  education  programs. 
While  providing  services  for  children  with  special  needs  re- 
mains an  important  part  of  the  BOCES  operation,  the  cooperative 
has  expanded  its  role  and  is  now  involved  in  extending  services 
to  all  9,200  students  in  the  seven  districts  (Weld  BOCES  infor- 
mation handout) . 

Like  the  NCEBOCS,  little  formal  policy  prescribes  the  Weld  BOCES'  service 
orientation. 

In  terms  of  organization  and  governance,  the  Weld  BOCES  is  similar  to 
the  NCEBOCS;  in  terms  of  programs,  it  is  different.    A  brief  look  at  the 
activities  of  other  Colorado  BOCS  suggests  that  this  is  generally  the  case 
(Colorado  BOCS  Study,  1975). 
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Ill    NEW  YORK:     BOARDS  OF  COOPERATIVE 
EDUCATIONAL  SERVICES  (BOCES) 


Overview  of  Policy  Relationships  for  New  York  BOCES 

The  BOCES  system  in  New  York  was  created  in  1948  iri  the  Intermediate 
District  Laws.     The  BOCES  were  intended  to  be  temporary  agencies  pending 
the  creation  of  intermediate  school  districts  (Colella  and  Foster,  1974), 
In  the  years  after  1948,  however,  the  BOCES  grew  stronger,  and  support 
for  the  creation  of  intermediate  districts  dwindled.     By  1967,  the  BOCES 
were  provided  with  the  legal  capability  to  acquire  facilities  to  house 
their  programs  (§1951,  Education  Code),  and  by  1972  the  article  title 
"Intermediate  School  Districts"  was  dropped  entirely  and  replaced  by 
"Boards  of  Cooperative  Educational  Services"  in  law  as  well  as  in  opera- 
tion (Article  40,  Ed.  Code).     There  are  now  46  BOCES;  in  1974,  all  but 
22  of  New  York's  735  school  districts  belonged  to  a  BOCES,  and  the  en- 
rollment of  member  districts  was  2,044,000.     The  New  York  BOCES  system, 
the  earliest  form  in  the  current  wave  of  regionalism  in  education,  is 
frequently  cited  in  the  literature  as  the  conceptual  precursor  to  other 
regional  or  intermediate  service  agencies. 

The  BOCES  are  service  agencies  that  reflect  the  educational  concerns 
of  both  the  state  education  agency  and  the  BOCES'  member  local  districts. 
Operation  and  activity  in  the  governance  system  take  place  at  three 
levels--the  State  Education  Department  (SED),  the  local  districts,  and 
the  BOCES;  educational  policy,  however,  is  formally  determined  at  the 
former  two  levels,  ,  • 

The  major  policies  that  govern  or  influence  BOCES'  organization  and 
activity  are:     (1)  Article  40  of  New  York's  Education  Code,  (2)  policies 
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of  the  BOCES  governing  board,  ana  (3)  policies  of  the  Bureau  of  School 
District  Organization  of  the  New  York  State  Education  Department.  Fig- 
ure VIII-3  shows  the  key  agents  in  the  BOCES  governance  system;  Table 
VIII-7  outlines  the  major  policy  relationships  among  them. 

Article  40  of  the  Education  Code--How  the  BOCES  Are  Organized 

The  1948  Intermediate  District  Laws  drew  out  the  concept  behind  the 
formation  of  BOCES  (and  the  never-developed  intermediate  districts): 

In  order  to  improve  educational  opportunities  in  rural  areas 
by  overcoming  the  handicaps  in  rural  education  that  arise 
f ronT sparsity  of  population  and  from  other  causes,  and  to 
provide  an  organizati^on  that  will  enable  local  school  dis- 
tricts to  combine  their  resources  for  the  effective  and 
economic  provision  of  educational  services,  it  is  hereby 
declared  to  be  the  policy  of  the  state  that  present  school 
districts,  except  city  school  districtfs,  cooperate  in  order 
that  additional  services  not  now  feasible  or  available  may 
be  provided  for  the  children  of  the  community  (L.  1948, 
Ch.  861,  §1). 

A  BOCES  is  established  by  order  of  the  Commissioner  of  Education  [§1950 
(1)  Ed.  Code]  in  approval  of  a  request  by  LBEs  not  already  a  part  of  a 
BOCES, 

. . .  for  the  purpose  of  carrying  out  a  program  of  shared  edu- 
cational services  in  the  schools  of  the  supervisory  district 
and  for  providing  instruction  in  such  special  subjects  as 
the  commissioner  may  approve  [§1950  (1)  Ed.  Code]. 

Members  of  the  component  LBEs  elect  members  of  the  BOCES  governing  board 
no  more  than  five  members  of  each  component  LBE  may  vote  in  elections  of 
BOCES  board  members.     The  maximum  size  of  a  BOCES  board  is  15;  the  mini- 
mum is  five.     There  are  no  eligibility  qualifications  for  BOCES  board 
members  except  that  they  must  reside  within  the  geographical  region 
served  by  the  BOCES  and  may  not  be  employees  of  any  component  school  dis 
trict  [§1950  (9)  Ed.  Code].     The  BOCES  itself  has  corporate  standing 
[§1950  (6)  Ed.  Code]. 
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© 
© 


Member 
LBEs/LEAs 


Note:  Circled  numbers  refer  to  policy  relationships;  these  are  outlined  in  Table  VIII-7. 

FIGURE  VIII-3    NEW  YORK  BOCES  AND  MAJOR  POLICY  RELATIONSHIPS 
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The  law  allows  for  the  formation  of  BOCES  from  supervisory  districts. 
Excluded  from  forming  or  belonging  to  a  BOCES  are  the  five  New  York  "city 
districts"--New  York  City,  Buffalo,  Rochester,  Syracuse,  and  Yonkers-- 
although  there  has  been  some  discussion  of  forming  BOCES-type  coopera- 
tives for  the  city  districts  as  well  (Nyquist,  1973),     [§1950  (8)  and 
§2550  define  city  districts  as  having  over  125,000  inhabitants.] 

Powers  of  the  BOCES  Board 

The  powers  of  the  BOCES  board  include  the  following: 

(1)  Appoint  a  district  superintendent.     The  superintendent 
is  subject  to  the  approval  of  the  Commissioner  of  Edu- 
cation, is  an  employee  of  the  SED,  and  is  paid  a  salary 
by  the  state  (§2204  Ed.  Code),     The  BOCES  board  may 
also  pay  the  superintendent  a  supplementary  salary 
[§1950  (4)   (a)  Ed,  Code],     The  district  superintendent 
has  two  other  formal  roles.     He  acts  as  the  superin- 
tendent of  schools  that  are  not  eligible  to  have  their 
own  superintendent  within  a  given  geographical  area 
called  a  supervisory  district.     As  a  state  employee, 

he  acts  on  behalf  of  the  SED  with  any  district  or 
agency  within  his  area. 

The  District  Superintendent,  ,then,  is  much  more  than 
the  superintendent  of  the  BOCES  agency.     The  "dual 
role"  is  a  key  one  in  the  governance  structure  and 
serves  as  a  two  way  communication  link  between  the 
state  [and]  local  levels  for  many  purposes,  both  for- 
mal and  informal  (J,  H.  Bishop,  1975). 

(2)  Prepare  tentative  budgets  for  presentation  at  an  annual 
meeting  of  member  LBEs,     The  budget  process  will  be 
discussed  in  greater  detail  below;  here,  however,  we 
note  that  the  budget  is  divided  into  administrative 
costs  that  must  be  shared  by  all  member  LEAs,  and  pro- 
gram costs  that  are  shared  only  by  participating  LEAs. 
Formulas  for  determining  shared  administrative  costs 
may  be  based  on  either  member  district  true  valuation 
or  weighted  average  daily  attendance,  but  not  both 
[§1950  (4)(b)  Ed,  Code], 
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(3)  Determine  member  district  needs  for  BOCES  services 
[§1950  (4)(c)  Ed.  Code].     This  responsibility  is  es- 
pecially important  because  it  allows  the  BOCES  to 
define  members'  needs  toward  which  BOCES  programs 
will  be  aimed. 

(4)  *'At  the  request  of  component  school  districts,  and 
with  the  approval  of  the "Commissioner  of  Education, 
provide  ...  services  on  a  cooperative  basis"  [§1950 
(4)(d)  Ed.  Code].     This  policy  appears  to  be  the  most 
important  in  that  it  links  all  BOCES  activities  with 
SED  approval  and,  at  the  same  time,  requires  that  the 
BOCES  obtain  approval  (by  request)  from  member  LEAs. 

(5)  Upon  recommendation  of  the  superintendent,  hire  ad- 
ministrative, clerical,  and  professional  people  [§1950 
(4)(e)  Ed.  Code]. 

(6)  Receive  and  disburse  and  apportion  funds  annually; 
contract  with  other  public  agencies  to  share  services 
and  facilities,  and  own  or  lease  television  facilities; 
and  contract  with  other  public  education  agencies  "in 
relation  to  the  program  of  the  BOCES"  [§1950  (4)(f-h) 
Ed.  Code]. 

(7)  Contract  to  provide  services  to  districts  outside  the 
BOCES  [§1950  (4)(r)  Ed.  Code], 

Reimbursement  of  Program  Costs 

Section  1950  (5)  of  the  Education  Code  describes  the  formula  by 
which  state  reimbursement  for  BOCES  service  costs  is  determined.  Roughly 
607o  of  the  participating  districts*  shares  are  paid  by  the  state,  but 
only  for  those  programs  that  have  been  approved  with  state  funding  by  the 
Commissioner  of  Education.     The  first  $9500  of  each  BOCES  employee's 
annual  salary  is  subject  to  state  reimbursement  by  the  formula;  any 
amount  above  this  annual  rate  is  excluded  and  not  subject  to  aid. 

BOCES  may  not  be  reimbursed  through  this  formula  for  educational 
television  facilities  and  programs--a  KPU  activity--f unded  by  §213  of  the 
EducatioT?' Code;  however,  amounts  generated  by  contracts  with  school  dis- 
tricts^ are  subject  to  aid.  _        '  ^ 
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Two  additional  provisions  affect  the  performance  of,  and  the  reim- 
bursement for,  BOCES  programs.  Both  theo  retically  add  to  a  BOCES  capa- 
bility to  perform  KPU: 

(1)  Nothing  in  this  act  shall  prevent  school  districts  or 
BOCES  with  the  approval  of  the  Commissioner  of  Education 
from  providing  cooperative  educational  services  for  which 
no  application  for  state  aid  is  to  be  made, 

(2)  Any  aid  apportioned  or  paid  by  the  state  to  a  BOCES  ex- 
perimental or  special  program  shall  not  be  utilized  in 
connection  with  computing  the  apportionment  to  such  a 
BOCES. 

[§1950  (5)  Ed.  Code] 
Approval  of  BOCES  Service  Programs  and  Budgets 

The  BOCES  law  sets  forth  certain  activities  relative  to  BOCES  pro- 
gram requests  for  approval  by  the  Commissioner  of  Education,  and  the 
setting  and  apportionment  of  the  annual  BOCES  budget.     These  activities 
must  take  place  within  a  three-month  period  every  year.     Figure  VIII-4 
shows  these  activities  staged  in  time. 

Because  proposals  for  BOCES  programs  may  be  generated  by  the  BOCES 
(in  response  to  needs  identification),  the  "request"  activity  is  usually 
a  solicitation  of  interest  in  a  list  of  proposed  programs.     The  BOCES 
organization  puts  together  the  list  and  distributes  it  among  the  various 
LEAs  to  determine  interest.     The  law  is  clear,  however ,  that  the  member 
LEAs  may  also  request  services,  and  there  is  no  indication  in  policy 
which  approach  is  favored. 

Review  of  a  BOCES  program  of  services  is  the  legal  responsibility 
of  the  Commissioner  of  Education.     The  operational  responsibility  for 
this  review,  however,   lies  with  the  Bureau  of  School  District  Organiza- 
tion (BSDO),  an  agency  within  the  SED. 
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DATE 


>  Dates  not  specified  in  Education 
I  Code;  each  BOCES  has  its  own  ' 
I  schedule.  ' 


1 


February  15 


March  1 5 


ACTIVITY 


Component  districts  request  program 
of  services  from  BOCES 


BOCES  board  submits  program  of 
services  to  Commissioner  of  Education 
for  approval  [§1950  (4)  (d)  Ed.  Code] 


BOCES  must  notify  component 
districts  concerning  approved  services 
for  ensuing  school  year 
[§1950  (4)  (d)  Ed.  Code] 


April  1 


Component  districts  must  notify  BOCES 
of  intention  or  nonintention  to  participate 
in  shared  services  [§  1950  (4)  (d)  Ed.  Code] 


April  MO 


May  15 


Annual  meeting  of  school  board  members 
and  trustees  of  component  districts  must 
be  held  to: 

(1)  Elect  BOCES  board  members  to 
fill  vacancies 

(2)  Inspect  tentative  budget  of  BOCES 
for  ensuing  year 

[§1950  (4)  (o)  Ed.  Code] 


BOCES  board  must  adopt  budget  and 

apportion  administrative  costs  to 

component  districts  [§  1950  (4)  (b)  Ed.  Code] 


FIGURE  VIII-4    BOCES  PROGRAM  SELECTION,  APPROVAL,  AND  BUDGETING  TIMETABLE 
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Activities  and  Policies  of  the  BSDO 

The  BSDO  has  developed  a  set  of  Criteria/Guidelines  detailing  the 
information  that  BOCES  must  include  in  a  projected  program  of  services 
submitted  to  the  BSDO  for  review.     These  guidelines  are  intended  to: 

•  Identify  and  describe  the  various  services  that  have  been 
approved  for  BOCES  sponsorship, 

•  Define  the  criteria  and  standards  that  are  used  to  deter- 
mine whether  or  not  approval  is  given  to  an  individual 
application. 

•  Describe  the  conditions  or  limitations,  if  any,  that  per- 
tain to  the  operation  of  each  service, 

(BSDO  BOCES  Administrative  Manual,  1974) 

The  general  guidelines  are  reproduced  in  Annex  B, 

Upon  receipt  of  proposed  programs  of  services,  the  BSDO  performs  an 
administrative  review  and  then  turns  the  individual  proposals  over  to 
separate  program  units  having  specialized  responsibility  for  in-depth 
review.     Thus,  the  BSDO  relies  heavily  on  other  SED  bureaus  for  assis- 
tance in  evaluating  BOCES  programs. 

The  February  15  deadline  for  submission  of  programs  of  services  is 
limited  to  ongoing  BOCES  programs  that  are  listed  in  the  "Criteria/Guide 
lines  for  BOCES  Services."    Proposed  services  that  satisfy  the  BSDO's 
definition  of  new  services  must  be  sent  to  the  BSDO  for  review  by 
October  31  of  the  year  preceding  implementation  of  the  proposed  service. 
According  to  a  BSDO  memorandum  regarding  "New  Service  Proposals,"  most 
new  BOCES  KPU  activity  would  fall  within  this  category: 

"New"  services  are  [defined  as]  those  which  include  elements 
- <    requiring  one  or  more  of  the  "new  service"  decisions  on  be- 
half of  the  Commissioner — (a)  educational  merit,  (b)  ratio- 
nale for  BOCES  involvement,  (c)  legitimacy  for  BOCES  sponsor- 
ship. 
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A  New  Service  Proposal  [must  be  filed]  for  services  which-- 

•  Do  not  appear  among  those  listed  in  the  Criteria/Guidelines 
for  BOCES  Services. 

•  Have  added  elements  beyond  those  included  in  an  approved 
service  for  1974-75  if  there  is  any  doubt  about  an  approval 
having  been  given  previously  in  some  BOCES. 

•  Propose  an  upgrade  or  extension  of  any  computer  service 
operation. 

•  Consist  largely  of  Developmental  Activities  (demonstra- 
tion, trial,  action/ research,  pilot) . 

(J.  H.  Bishop,  1974) 

The  selection  process  for  new  services  is  the  same  as  for  other  programs 
except  that  additional  criteria  must  be  considered  and  BOCES  must  make 
application  by  the  earlier  date. 

New  Service  Proposals  must  be  accompanied  by  the  following  informa- 
tion: 

(1)  Description  of  New  Service — Provide  a  summary  description 
of  the  proposed  courses,  functions,  and  needs  to  be  met. 

(2)  Rationale- -Indicate  why  a  BOCES  Shared  Service  ±s  neces- 
sary rather  than  service  provided  by  the  district (s). 

(3)  Target  Group  To  Be  Served--Indicate  the  specific  target 
group  to  be  served. 

(4)  Planning  Ef f ort--Indicate  the  planning  which  has  been 
accomplished  to  date,  including  method  used  to  arrive 
at  determining  the  need.     What  involvement  have  the 
school  districts  had  in  planning?    What  is  the  school 
district(s)'  commitment ,  and  what  coordination  is  there 
with  other  agencies  executing  similar  programs? 

(5)  Magnitude  of  New  Service--Indicate  whether  the  program 
is  immediate  or  long  range,  what  program  units  are  in- 
volved, how  many  students  or  teachers  are  involved, 
and  what  the  financial  commitment  is. 

(6)  Evaluation  Plan--Indicate  the  proposed  procedure  for 
evaluating  the  success  of  the  project. 

(SED  Proposal  Cover  Sheet) 
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Whether  the  proposed  program  is  *^old"  or  "new,"  BOCES  programs  must  be 
reviewed  on  an  annual  basis.  Consequently,  a  BOCES  service  or  project 
of  longer  than  one  year's  duration  may  be  canceled  by  the  BSDO  if  cir- 
cumstances warrant. 

After  a  program  of  services  has  been  reviewed,  it  is  either  approved, 
approved  without  state  aid,  or  disapproved  by  the  BSDO.     The  effect  of 
disapproval  is  final.     The  effect  of  an  approval  without  state  aid  is 
that  component  school  districts  may  not  be  reimbursed  by  the  state  for 
payments  made  to  the  BOCES  for  an  "unaided"  service.    However,  where 
economy  of  scale  and  other  practical  considerations  predominate,  dis- 
tricts may  well  participate  in  an  unaided  program  despite  the  absence 
of  state  aid.     Approval  with  state  aid  is  discussed  in  the  following  sec- 
tion on  BOCES  funding  mechanisms. 

Policies  that  bear  on  the  approval  of  services  and  programs  gener- 
ally allow  a  great  deal  of  discretion..  Proposal  review,  for  example,  is 
not  .an  "input /output"  process;  rather,  it  entails  varying  degrees  of 
interaction  and  negotiation  between  the  SED/BSDO  agency  and  the  applying 
BOCES.     Although  this  interaction  is  not  the  subject  of  this  report,  its 
importance  in  the  overall  selection  process  should  be  recognized, 

A  similar  negotiating  process  takes  place  between  the  BOCES  itself 
and  its  member  LEAs--first,  in  identifying  needs;  second,  in  selecting 
appropriate  programs  aimed  at  solutions;  and  third,  in  (the  LEAs')  choos- 
ing whether  or  not  to  participate  in  a  given  program. 

BOCES  Funding  Mechanisms 

The  New  York  BOCES  have  no  taxing  authority  and,  unlike  the  Colorado 
BOCS,  receive  no  direct  aid  from  the  state.     Instead,  BOCES  fund  their 
operations  through  a  combination  of  administrative  fees  that  are  contracts 
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shared  among  all  component  districts,  service  fees  that  are  contracts 
made  with  participating  districts,  and  awards  from  outside  agencies. 

The  costs  of  administration  for  a  BOCES  are,  within  certain  con- 
straints, shared  by  all  component  LEAs  of  the  BOCES  [§1950  (4)(b)  Ed. 
Code],     As  noted  above,  the  BOCES  are  required  to  adopt  a  budget  by 
May  15  each  year.     In  this  budget,  administrative  costs  are  delineated 
separately  from  service  costs,  subject  to  restrictions  in  §1950  (5)  of 
the  Education  Code.     Charges  against  the  district  are  then  made  by  one 
of  two  apportionment  formulas --district  true  valuation  or  weighted  aver- 
age daily  attendance- -and  all  component  districts  share  these  costs  pro- 
portionally. 

Contracts  for  services  are  the  primary  funding  mechanisms  for  the 
BOCES.     By  April  1  each  year,  the  component  districts  must  notify  the 
BOCES  of  their  willingness  or  unwillingness  to  participate  in  service 
programs  approved  for  the  following  year.^^    This  fee,  under  §1950,  is 
equal  to  the  actual  cost  of  providing  the  service  in  question;  in  effect 
service  costs  are  shared  only  among  those  disLi-icts  that  choose  to  parti 
cipate  in  that  service.     Each  participating  district  makes  monthly  pay- 
ments on  its  contract  with  the  BOCES.     An  audit  of  actual  costs  is  con- 
ducted at  the  end  of  each  year  and  becomes  the  basis  upon  which  state 
aid  is  computed.     State  aid  is  then  paid  to  the  participating  districts 
in  accordance  with  §1950  (5)  of  the  Education  Code.     The  state  aid  for- 
mula results  in  a  return  of  about  60  cents  on  the  dollar  to  participat- 
ing LEAs. 

BOCES  are  also  empowered  to  provide  services  by  contract  to  non- 
member  LEAs  and  other  BOCES  [§1950  (4)(f),(r),  and  (w)  Ed.  Code].  Like 

*One  respondent  indicated  that  there  is  actually  considerable  latitude 
in  the  ''commitment  for  participation''  process;  letters  of  intent  and 
similar  less  formal  commitments  may  suffice,  and  a  redetermination  of 
participation  takes  place  at  a  later  time. 
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services  with  the  BOCES  "approved  without  state  aid,"  these  service  fees 
ate  nonreimbursable.     Ordinarily,  BOCES  services  are  not  requested  by  out 
side  districts  unless  they  represent  substantial  savings  to  that  LEA  or 
BOCES . 

Finally,  BOCES  may  receive  funding  from  other  outside  sources  (e.g., 
federal  education  agencies  like  the  Office  of  Education  and  NIE,  and  pri- 
vate foundations)  and  from  the  SED  under  special  programs  [§1950  (4)(h) 
(2)  Ed.  Code]. 

There  is  one  other  funding  mechanism  (§1951  Ed.  Code)  that  is  for 
non-KPU  activities--i. e. ,  purchasing  real  property;  we  will  not  discuss 
it  here. 

Typically,  a  BOCES  uses  a  combination  of  mechanisms  to  fund  programs 
A  number  o£  KPU  projects  reviewed  had  a  mixture  of  funding  sources,  mak- 
ing use  in  particular  of  state  aid  and  federal  grants. 

KPU  Policy  in  One  BOCES--Nassau  County  BOCES 

The  Nassau  County  BOCES,  headquartered  in  Westbury,  New  York,  is. 
the  largest  of  the  state's  46  BOCES.     It  serves  56  school  districts,  and 
its  1975-76  budget  is  over  forty  million  dollars.     The  Nassau  BOCES  has 
its  own  R&D  Division,  headed  by  a  director  who  is  responsible  to  the 
BOCES*  district  superintendent.     R&D  Division's  1975^76  budget  is 
$1,192,000,  of  which  $913,000  is  for  services  contracted  with  partici- 
pating districts  (BOCES  of  Nassau  County,  "1975/76  Consolidated  Budget 
Suimary,"  1975)  . 

The  R&D  Division  operates  a  number  of  KPU  programs;  by  far  the' 
largest  is  the  Cooperative  Area  Program  (CAP),  which  is  funded  at 
$935,212  for  1975-76.     CAP  is  a  program  through  which  member  districts 
and  BOCES  R&D  staff  coordinate  the  preparation  and  evaluation  of  KPU 
proposals  for  review  by  the  BSDO.     The  BOCES  R&D  Division  has  published 
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guidelines,  that  outline  the  steps  in  the  proposal  process;  the  following 
discussion  summarizes  the  policy. 

CAP  Policy 

CAP  proposals  begin  through  a  variety  of  needs  identification  activ- 
ities.    A  member  district,  a  cluster  of  districts,  the  BOCES  R&D  Division, 
and  others  may  individually  or  jointly  identify  problem  areas  in  which 
R6tD  might  provide  an  effective  solution.     The  BOCES  R&D  Division  coordi- 
nates proposal  writing  and  disseminates  proposals  to  other  member  dis- 
tricts to  determine  their  interest  in  participation.     A  technique  called 
Program  Planning  Specifications  is  used  for  all  CAP  proposals,  and  there 
is  heavy  emphasis  on  evaluation  components  in  the  proposed  programs.  In 
effect,  these  activities  satisfy  the  §1950  requirements  of  the  BOCES. 

BOCES  R&D  Division  then  sends  the  proposal(s)  to  SED/BSDO  for  re- 
view.    Upon  acceptance  of  the  proppsalCs),  the  R&D  Division  coordinates 
the  use  of  consultants  in  any  approved  projects.* 

Generally,  two  kinds  of  developmental  activities  are  done  under  CAP; 
the  dissemination  processes  for  these  are  different.     Staff  development 
proposals  are  distributed  to  all  member  districts,  and  evaluation  results 
are  compiled  and  distributed  by  the  R&D  Division.     Curriculum  development 
activities,  on  the  other  hand,  are  coordinated  by  the  Nassau  Educational 
Resource  Center  (the  BOCES'  "KPU  library''),  and  CAP  curricula  are  avail- 
able to  any  interested  member  district.     Finally,  the  BOCES  R&D  staff 
"provide  [the]  entire  curriculum  development  network  with  a  continuous 
evaluative  feedback''  (Nassau  BOCES  CAP  Policy). 


A  respondent  indicated  that  most  CAP  projects  entail  curriculum  develop 
ment;  usually,  several  teachers  from  a  participating  district  will  work 
in  the  BOCES  as  consultants  for  the  duration  of  the  project. 
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The  BOCES  R&D  Division  charges  participating  CAP  districts  a  157o 
"overhead"  charge  for  proposal  assistance,  administrative  support,  and 
other  BOCES  staff  support  services.     CAP  projects  accounted  for  about 
927o  of  all  Nassau  BOCES  R&D  in  1974-75  (Callahan,  1975), 

BOCES  as  an  Influential  Organization  in  KPU 

While  both  the  approval  of  the  BSDO  and  the  participation  of  at 
least  two  local  districts  are  necessary  to  carry  out  a  BOCES  program, 
one  respondent  noted  that  BOCES  itself  plays  a  leading  role  in  identify- 
ing needs  and  designing  KPU  programs.     Such  activity  is  well  within  the 
powers  drawn  out  for  BOCES  in  §1950  of  the  Education  Code.     Tha  effect 
is  that,  while  governing  only  in  an  operational  sense,  the  BOCES  can 
strongly  influence  what  kind  of  KPU  takes  place.     As  a  relatively  larger 
(with  respect  to  its  member  LEAs)  central  organization,  the  BOCES  is  also 
more  likely  to  be  aware  of  the  external  climate  for  KPU--e.g.,  kinds  of 
programs  being  supported,  the  availability  of  funds,  and  exogenous 
policy--than  its  member  districts.     In  New  York,  then,  the  BOCES  are 
probably  key  agencies  in  the  state  system  for  conducting  KPU  oriented 
toward  the  classroom. 
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IV    CONCLUSIONS  AND  RECOMMENDATIONS 


Contrasting;  the  Two  Governance  Systems 

We  have  described  in  detail  the  formal  components  of  governance  for 
BOCES  in  New  York  and  BOCS  in  Colorado.     The  most  important  factors  that 
underlie  and  ultimately  determine  what  activities  do  take  place  are  (1) 
the  needs  of  component  school  districts  that  can  best  be.  met  by  coopera- 
tive efforts  and  (2)  most  importantly,  these  districts'  approval  of  and 
willingness  to  participate  in  programs  of  the  BOCES.     Although  the  Colo- 
rado and  New  York  systems  appear  similar,  there  are  important  differences 
Table  VIII-8  outlines  the  major  aspects  of  governance  in  both  systems. 

The  differences  that  should  be  highlighted  are  (1)  the  agents  in 
the  governance  process,  their  location,  and  their  powers,   (2)  the  actors 
whose  needs  and  goals  are  reflected  in  such  a  process,  and  (3)  the  major 
incentives  that  encourage  member  LEAs  to  use  the  BOCES.     All  of  these 
factors  are,  of  course,  related. 

New  York  BOCES 

Of  the  two  types  of  ISAs,  New  York's  BOCES  are  governed  by  and  make 
use  of  more  formal  policy  mechanisms.  Paradoxically,  the  New  York  BOCES 
is  probably  the  stronger  organization  and  is  less  constrained  by  policy. 

A  configuration  of  three  agents  selects  BOCES  programs  in  New  York. 
The  BOCES  itself  may  take  the  initiative  in  defining  local  needs  and 
designing  programs  to  meet  them,  but  any  such  proposals  must  be  approved 
by  the  BSDO  and  the  programs  must  be  attractive  enough  to  elicit  parti- 
cipation by  at  least  two  component  LEAs.     There  is  a  powerful  incentive 
for  the  LEAs  to  participate  in  BOCES  programs,  i.e.,  the  state  aid 
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Table  VIII-8 
COblPARISON  OF  FORMAL  GOVERNANCE  FACTORS 


Factor 

New  York 

Colorado 

Levels  of  effective  govern^ince 

3 

2 

Key  links  between  levels 
BOCES-'LEAs 

SED--BOCES 

Superintendent  governs  small 
LEAS 

BOCES  board  sets  overall 
policy 

LEA  participation  and  partial 
funding  (at   least  two  LEAs 
for  a  given  program) 

Superintendent  (SED  employee) 
BSDO  review  process 
State  aid  formula 

BOCS  board  sets  overall  policy  and 

approves /disapproves  programs 
LEA  participation  and  funding 

SDE  $10,000  grant  (no  more  than  17 
BOCS) 

Regional  field  coordinators  "con- 
sultative assistance" 

Formal  governing  agents 

BOCES  board  through 

district  superintendent 
SED  through  superintendent 
BSDO/SED  through  review  process 
LEAs/LBEs  through  participation 
and  BOCES  board 

BOCS  board  through  executive  director 
LEAs  through  program  participation 

and  advisory  council 
LBEs  through  BOCS  board 

Fiscal  policy  mechanisms 
Administrative 

Service  programs 

LEA  dues  (two  formulas) 

Participating  LEAs  with  60% 

state  aid 
Outside  contracts  (grants  and 

sale  of  services) 

State  $10,000  grant 

LEA  dues  (several  fo'rmulas) 

Participating  LEAs 

Outside  contracts  (grants  and  sale  of 
services) 

Governing  board  makeup 

Partially  representative 

(5  to  15  members) 
Must  live  in  BOCES  region  and 

not  be  LEA  employee 
Five-year  term 

Fully  representative  (all  LEAs 

represented) 
Must  be  member  of  LBE  (a  director) 

Term  same  as  term  on  LBE 

Meeds  and  goals  reflected 

Statewide  through  BSDO  review 

and  superintendent 
Professional  (BOCES  staff) 
LEAs  through  needs • surveys 
service  requests,  and  parti- 
cipation 

LEAs  through  participation,  advisory 
council,  and  service  requests 

Professional  (BOCS  staff  and  advisory 
council) 
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formula  that  returns  to  the  participating  districts  about  60%  of  their 
costs.     In  a  time  of  rising  educational  costs,  it  is  generally  to  the 
member  LEAs  '  advantage  to  do  through  the  BOCES  what  tjiey  might  otherwise 
do  themselves.     In  particular,  district  activities  that  have  low  visibil- 
ity--i.e.,  activities  not  necessary  for  a  district's  ''image"  in  its  com- 
munity--are  likely  to  take  place  under  the  BOCES  arrangement.    Most  KPU 
probably  falls  into  this  category,  although  radical  innovations  no  doubt 
meet  with  some  public  resistance  at  the  LEA  level. 

— -— — ^"'^"^ 

At  the  same  time,  the  BOCES  must  be  (1)  contract  responsive  to  their 
clients  and  their  member  districts  and  (2)  sufficiently  aware  of  SED 
goals  to  design  programs  that  are  likely  to  be  approved  with  state  aid. 
The  underlying  goal  of  the  BOCES  sys tem--taking  advantage  of  economies 
of  scale  for  cooperation  in  educat ion--and  the  need  to  be  responsive  to 
two  governing  configurations  have  naturally  led  to  the  growth  of  a  strong 
professional  and  administrative  staff  in  the  BOCES  organization. 

Finally,  the  district  superintendent,  who  has  several  non-BOCES  jobs, 
acts  as  another  strong  link  for  the  three  agencies,  connecting  the  SED, 
the  BOCES,  and  the  BOCES'  LEAs. 

The  New  York  system,  then,  should  be  considered  more  than  a  service 
cooperative.     It  is  an  important  link  in  a  hierarchically  organized  edu- 
cation network,  communicating  local  needs  to  the  SED  and  statewide  pol- 
icy and  priorities  to  the  local  agencies. 

Colorado  BOCS 

Colorado's  BOCS,  on  the  other  hand,  are  almost  completely  indepen- 
dent of  state  governance.    While  each  authorized  BOCS  receives  an  annual 
$10,000  grant  from  the  SDE,  this  fiscal  mechanism  cannot  be  considered 
similar  to  New  York's  state  aid  formula;  it  is  by  no  means  a  regulatory 
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device,  except  that  the  underlying  legislation  restricts  the  number  of 
authorized  BOGS. 

Colorado  BOGS  are  "policy-constrained"  in  one  direction  only;  both 
governance  and  program  selection  policies  emphasize  their  tie  to  their 
member  districts.'     Since  their  member  districts  are  not  "reimbursed  for 
program  costs,  the  only  incentive  to  use  the  BOGS  is  the  ^advantage  of 
cooperation. 

The  makeup  of  the  BOGS  governing  board  and  the  BOGS  advisory 
council--representative  of  the  member  LBEs  and  LEAs  respectively--f urther 
links  a  BOGS  to  its  local  members.     Both  the  board  and  the  council  play 
active  roles  in  program  selection.     The  only  role  for  the  SDK  is  consulta- 
tive, informing  the  BOGS  of  state  policy  and  opportunities  for  program 
funding,  and  assisting  with  organizational  and  management  problems. 

Gonsequently ,  a  BOGS  very  existence  remains  at  the  mercy  of  its 
member  districts;   in  this  sense,  it  is  more  a  "cooperative"  than  the  New 
York  system.     We  do  not  imply  that  this  is  bad;  in  fact,  it  reflects  the 
strong  flavor  of  local  autonomy  that  pervades  Golorado's  education  system. 
Given  these  constraints,  BOGS  in  Golorado  are  less  likely  to  develop  into 
the  strong  bureaucracy  that  characterizes  the  New  York  BOCES. 

KPU  in  BOGES 

From  the  perspective  of  KPU  management,   the  New  York  BOGES  might  be 
seen  as  wearing  "three  hats"--the  needs  of  local  members,  the  priorities 
of  the  SED,  and  the  internal  professional  and  administrative  interests  of 
a  strong  education  agency.     Golorado,  on  the  other  hand,  wears  a  "hat-and- 
a-half"--its  members'  interests  and  the  interests  of  a  relatively  small  • 
and  highly  dependent  agency. 

What  does  this  mean  for  KPU?    From  the  perspective  of  formal  policy, 

*  * 
there  is  little  difference  between  the  two  systems.     Sprinkled  through 
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the  important  policies  is  the  authority  to  do  a  number  of  things  that  are 
clearly  KPU;  for  the  most  part,  these  are  information  dissemination  sys-' 
terns  and  media  services,  in-service  training  for  teachers,  and  curriculum 
development.  Both  of  the  BOCES  carry  on  such  activities.  The  respective 
education  codes  also  permit  any  activities  requested  by. the  local  members 
(in  New  York,  approval  of  the  BSDO  is  required),  but,  where  we  found  KPU, 
it  did  not  appear  to  deviate  much  from  the  three  kinds  of  activities 
noted  above. 

Significant,  however,  in  the  formal  policies  that  isurround  KPU  ac- 
tivities is  the  requirement  for  needs  assessment  and  program  evaluation* 
Apparently  the  BOCES  have  been  highly  successful  in  formalizing  these 
processes.     This  should  be  helpful  for  outside  agencies  that  have  the 
role,  either  assigned  or  voluntary,  of  promoting  and  supporting  innova- 
tion. 

Likewise,  the  recent  history  of  KPU  in  both  BOCES  organizations 
suggests  that  these  ISAs  are  effective  in  continuing  exemplary  KPU  pro- 
grams after  initial  funding  has  ended.     That  such  activities  must  be  of 
substantive  value  to  at  least  some  of  the  member  districts  supports  our 
contention  that  the  most  meaningful  KPU  is  that  which  finds  its  applica- 
tion at  the  local  level.     The  BOCES,  then,  can  be  seen  as  potentially 
important  KPU  dissemination  agencies. 

Recommendat  ions 

.Generally,  we  make  two  kinds  of  recommendations  in  this  study. 
First,  we  have  looked  only  at  formal  policy  and  only  to  a  certain  level 
of  detail;  consequently,  our  description  is  only  partial,  and  we  want  to 
recommend  possible  extensions  of  this  kind  of  research  effort.  Second, 
the  information  we  have  collected  does  lead  to  some  recommendations  for 
both  improving  communication  and  dissemination  between  KPU  agencies  at 
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different  levels,  and  for  monitoring  the  climate^ for  KPU  in  the  two  ISAs 
and  their  member  districts. 


Further  Studies 

(1)  This  study  indicates  that  the  most  important  governance 
considerations  revolve  around  program  selection  policies 
and  funding  mechanisms.    .While  a  number  of  earlier  studies, 
especially  Stephens   (1975),  describe  the  general  frame- 
work within  which  other  ISAs  (or  RESAs)  operate,  they 

do  not  necessarily  detail  either  of  these  factors  within 
a  common  framework.     A  more  detailed  analysis  of  formal 
policy  in  these  areas  would  prove  useful  to  outside 
agencies  that  promote  and  fund  KPU,  and  to  state  edu- 
cation agencies  interested  in  the  ISA  concept  for  their 
own  states. 

(2)  This  study  looked  only  at  formal  policy;  for  the  most 
part,  this  was  policy  as  it  now  exists.     To  better  assess 
the  effects  of  governance,  a  study  that  reviews  KPU  pro- 
gram history  in  the  various  ISAs --both  those  studied 
here  and  those  not  considered--should  prove  a  good  mea- 
sure of  how  well  policies  actually  work.     Given  the 
nature  of  ISAs,  such  research  should  be  conducted  at  the 
level  of  the  intermediate  agency;  for  the  most  part,  it 
would  consist  of  survey  research.     Tied  to  a  more  compre- 
hensive explication  of  policy,  such  an  effort  should  im- 
prove information  about  both  governance  and  KPU  activi- 
ties . 

(3)  In  the  two  governance  systems  studied,  the  inclinations, 
whether  formal  or  not,  of  member  LEAs  were  found  to  be 
important  factors  in  the  selection  of  KPU  programs.  We 
did  not  look  for  formal  statements  of  such  interest.  Such 
statements  may  exist  in  the  policies  of  LBEs  or  in  the 
needs  statements  prepared  by  LEA  staff,  but  certainly 

the  records  of  LBE  meetings  would  indicate  some  of  the 
rationale  behind  electing  to  participate  or  not.  A 
more  detailed  policy  analysis  at  the  local  level  might 
reveal  these  criteria,  but  such  a  study  would  no  doubt 
be  expensive.     While  research  of  this  nature  might  prove 
useful,  we  believe  that  consideration  of  costs  versus 
benefits  would  preclude  research  of  this  nature.  How- 
ever, it  should  be  considered  as  a  potential  project. 
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(4)  Finally,  we  have  merely  alluded  to  the  informal  factors 
that  are  an  important  part  of  governance.  An  analysis 
such  as  this  one  does  require  a  better  understanding  of 
these  factors,  and,  in  general,  we  consider  such  an  ex- 
tension of  the  framework  to  be  a  logical  next  step. 
Extending  this  pafSaigm  to  consider  informal  factors  is 
discussed  at  length  elsewhere  in  the  overall  report, 

KPU  Monitoring  and  Policy 

(1)  Although  for  different  reasons,  there  is  a  single  agency 
in  each  state  studied  that  is  a  focal  point  for  ISA  in- 
formation.    In  Colorado,  this  agency  is  the  Regional 
Field  Coordinators  Unit  of  the  Colorado  Department  of 
Education;  in  New  York,  it  is  the  Bureau  of  School  Dis- 
trict Organization  of  the  State  Education  Department. 

We  recommend  that  NIE'laonitor  these  agencies  to  collect 
information  about  (a)  the  history  of  KPU  activities  in 
the  states'  ISAs,*  (b)  local  needs  and  priorities  for  KPU, 
and  (c)  changes  in  state  and  local  policy  that  might  af- 
fect these  activities.     Conversely,  NIE  should  consider 
the  two  agencies  as  primary  dissemination  points  for 
information  about  NIE  programs  and  policy;  both  agencies 
should  be  willing  to  distribute  these  data  to  their 
respective  BOCES. 

(2)  Both  ISA  systems  should  consider  the  value  of  .shared 
information.    While  Colorado  already  has  two  mechanisms 
for  sharing--the  regional  coordinators  and  the  Colorado 
BOCS  Association --we  identified  none  in  New  York.  While 
it  would  be  naive  to  assume  that  informal  networks  do 
not  already  exist,  we  do  encourage  strengthening  them. 
"Invisible  colleges''  that  include  both  the  BOCES  and. 
the  member  districts  should  provide  an  effective  forum 
for  exchanging  information  about  management  in  general, 
and  innovation  activities  in  particular.    NIE  should 
consider  supporting  such  an  effort. 

(3)  Other  SEAs  should  find  this  report  useful.     While  it  is 
not  certain  that  ISAs  represent  the  "wave  of  the  future" 
in  educational  governance,  they  are  clearly  one  of  a  • 
number  of  viable  institutions  being  used  to  improve  ser- 
vices for  local  agencies.     The  information  we  present 
here  should  provide  good  background  for  other  states 
considering  ISAs. 
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(4)  The  effectiveness  of  needs  assessment  and  program  evalu- 
ation policies  leads  us  to  recommend  them  as  potential 
policy  models  for  other  education  agencies--f ederal , 
state,  and  local.     Insofar  as  these  techniques  are  in- 
creasingly important  in  decision  making  and  planning, 
formal  means  of  fostering  their  acceptability  to  agencies 
more  inclined  to  do  things  "the  same  old  way"  are  im- 
portant aspects  of  organizing  for  innovation, 

(5)  Finally,   the  ability  of  BOGES  to  continue  exemplary 
programs  after  initial  funding  has  ceased  provides  an 
important  example  for  both  NIE  and  other  agencies  pro- 
moting innovation  responsive  to  local  needs.     The  policy 
mechanisms  that  underlie  this  success  should  be  con- 
sidered as  potential  models  for  solving  continuation 
problems  that  plague  other  agencies. 

Conclusion 

BOCES  in  New  York  and  BOGS  in  Colorado  are  examples  of  regionalism 
in  education  in  general,  and  of  intermediate  service  agencies  in  particu 
lar.     A.  number  of  factors  noted  here  and  elsewhere  in  the  education  lit- 
erature (e.g.,  declining  enrollment,  increasing  age  of  the  teacher  popu- 
lation, and  strains  on  local  education  funding  sources  like  property 
taxes)  indicate  that  intermediate  service  agencies  may  become  increas- 
ingly important  actors  in  the  public  education  system..    An  understanding 
of  how  and  what  needs  are  now  being  met  by  BOCES  and  other  ISAs  can  aid 
KPU  and  other  education  planners  in  designing  the  educational  organiza- 
tions  and  programs  of  the  future. 
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Annex  B 


NEW  YORK  BSDO  CRITERIA  AND  GUIDELINES 

General  Principles  Governing 

Boards  of  Cooperative  Educational  Services 

BOCES  in  effect  became  the  permanent  agency  at  the  intermediate 
level  of  the  New  York  State  system  of  public  schools  by  two  legislative 
actions.     In  1967,  action  was  taken  to  authorize  the  acquisition  of 
land  and  buildings;   in  1972,  the  authorization  for  the  formation  of 
intermediate  districts  was  repealed. 

It  should  be  emphasized  that  no  matter  how  excellent  the  program 
and  operation  of  the  intermediate  agency  may  be,  the  school  district  is 
the  basic  unit  for  providing  instructional  services.     The  BOCES  should 
not  be  considered  as  a  substitute  for  adequate  districts. 

Principles  governing  the  operation  of  boards  of  cooperative  edu- 
cational services  are  outlined  below. 

(1)  BOCES  services  to  districts  are  to  be  considered  as  an 
arm  of  the  local  school  districts  to  supplement,  advise 
and  support  the  activities  and  services  operated  by 
districts. 

(2)  Any  activity  operated  by  a  BOCES  will  be  expected  to 
meet  all  of  the  current  requirements  of  the  Education 
Law,  Regulations  of  the  Commissioner  and  recognized 
standards  of  practice  that  would  be  applicable  to  a 
school  district  operating  a  similar  activity,  unless 
the  BOCES  is  specifically  excepted. 

(3)  Component  districts  (users)  should  be  directly  involved 
in  the  planning  and  decision  making  leading  to  the  es- 
tablishment and  operation  of  shared  service  programs. 

A  new  service  should  be  initiated  on  the  basis  of  estab- 
lished need,  after  component:  districts  have  indicated 
interest  in,  acceptance  of  and  commitment  to  support 
the  service. 
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Cooperative  programs  and  services  should  avoid  dupli- 
cating, overlapping  or  de-emphasizing  responsibility 
which  properly  belongs  to  the  school  district. 

Each  shared  service  should  be  developed  on  the  basis 
of  effectiveness  or  economies  or  as  a  demonstration 
project  or  some  combination  of  these  factors. 

Duplication  of  state  aid  should  be  avoided. 

There  must  be  clear  justification  for  a  shared  program 
or  service  when  such  would  supplant  services  expected 
from  school  district  sponsorship. 

Shared  itinerant  classroom  teachers  should  be  limited 
to  school  districts  where  quality  of  programs  can 
best  be  maintained  by  part-time  staff  assignment. 

New  services,  programs  and  administrative  functions 
should  be  initialed  only  when  adequate  and  competent 
personnel  can  be  employed  and  satisfactory  arrange- 
ments secured  in  order  to  ensure  the  success  of  the 
activity. 

General  Criteria  for  the  Operation  of 
Boards  of  Cooperative  Educational  Services'^ 

(1)  Any  function  or  service  supported  within  the  service 
budget  of  a  BOCES  must  be  approved.     An  application 
for  EACH  such  service  must  be  submitted  and  approved 
by  the  Commissioner  of  Education  before  that  service 
begins,  regardless  of  the  source  of  funding. 

(2)  Each  aided  service  must  be  operated  on  a  shared  basis. 

•  A  service  rendered  to  a  single  district  is  not 
considered  a  shared  service.     Each  service  must 
be  provided  to  two  or  more  districts  to  be  con- 
sidered a  shared  service,  a  requirement  for  aid 
eligibility. 

•  Application  and  approval  of  an  area  service  is 
for  the  "program"  presented  rather  than  for  the 
portion  used  by  each  individual  district. 

•  A  service  shared  by  schools  in  two  or  more  BOCES 
must  originate  with  one  board  and  is  secured  by 
other  boards  through  purchase  contract. 
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(4) 

(5) 

(6) 
(7) 

(8) 

(9) 


BCX^ES  may  provide  services  for  which  no  state  aid  is 
claimed.     The  Commissioner's  approval  is  required.  In 
some  instances,  specific  criteria  applying  to*  similar 
aided  services  may  be  waived. 

Services  provided  must  meet  or  exceed  recognized  stan- 
dards to  justify  the  use  of  BOCES  aid.     It  is  partic- 
ularly Important  that-- 

•  Teachers  and  other  professional  employees  of  BOCES 
shall  be  subject  to  the  same  requirements  for  certi- 
fication as  if  they  were  employed  by  school  districts. 

•  Physical  facilities  essential  to  providing  a  satis- 
factory environment  for  the  service  proposed  must 
be  available  and  meet  standards  and  requirements 

of *the  Department  [SED]. 

In  regard  to  itinerant  personnel-- 

•  A  single  district  is  limited  to  three-fifths  (607o) 
of  a  person's  time.     A  district  may  not  expect 

to  use  most  of  person's  time  in  token,  sharing  with 
other  districts. 

•  For  each  new  service  application,  the  district 
superintendent  shall  submit  two  copies  of  a  writ- 
ten statement  explaining  the  circumstances  and  an 
explanation  supporting,  with  reasons,  the  service 
requested. 

•  Where  itinerant  services  are  proposed  for  school 
districts  subject  to  reorganization,  evidence  must 
by  presented  to  indicate  that  such  services . will 
not  postpone  or  retard  progress  toward  reorganiza- 
tion.    It  may  be  necessary  to  limit,  disapprove  or 
discontinue  aided  services  to  such  school  districts. 

•  Combinations  of  classroom  teaching  or  special  ser- 
vice personnel  for  a  single  district  which  may  be 
considered  a  full-time  local  position  will  not  be 
aided  as  shared  services;  e.g.,  Agriculture/Indus- 
trial Arts,  Nurse-Teacher/Attendance  Teacher,  In- 
dustrial Arts/Driver  Education. 

A  person  may  not  be  an  employee  of  a  BOCES  providing  a 
service  to  a  school  district  and  at  the  same  time  be  an 
employee  of  that  school  district  in  a  similar  or  dif- 
ferent instructional  area. 
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(7)  Approval  of  a  service  is  for  one  year  only.     Each  ser- 
vice will  be  reviewed  annually  through  the  Bureau  of 
School  District  Organization  and  other  appropriate  pro- 
gram units  to  determine  which  may  be  continued. 

•  Annual  evaluation  will  consider  long  range  plans 
of  the  Department  as  well  as  specific  criteria 
appropriate  to  the  service. 

•  The  practical  effects  upon  the  services  to  children 
will  have  a  bearing  on  the  mechanics, of  phasing  out 
a  program. 

(8)  Approval  of  service  applications  should  not  be  expected 
in  these  circumstances. 

•  Where  the  proposed  service  would  replace  services 
presently  (sic)  provided  on  a  sound  basis  by  indi- 
vidual districts,  or 

•  Where  the  proposed  service  could  or  should  be  ren- 
dered effectively  by  the  individual  districts. 

(9)  Sparsity  of  population,  distance,  travel  time  and  other 
pertinent  factors  will  be  given  consideration  with  re- 
spect to  applying  criteria  for  any  specific  service. 

(10)    Major  area  programs  such  as  occupational  education,  and 
computer  services  are  to  be  developed  with  ongoing  user 
committee  involvement  at  the  technical  and  executive 
levels,  particularly  during  the  phases  of  planning, 
monitoring  and  evaluation. 
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I  INTRODUCTION 


In  1970^  the  federal  government  funded  three  states — Oregon^  South 
Carolina,  and  Utah — to  establish  pilot  dissemination  programs  utilizing 
the  extension  agent  concept  that  had  worked  successfully  for  the  Department 
of  Agriculture.     The  Pilot  State  Dissemination  Program  (PSDP)  offers  two 
characteristics  of  considerable  interest  to  our  overall  study.     First^  it 
deals  with  a  novel  method  of  dissemination^  one  which  by  virtue  of  its 
structural  characteristics  should  be  an  interesting  case  from  the  stand- 
point of  knowledge  production  and  utilization  (KPU)  governance.  Second^ 
it  is  an  exploratory  program^  one  in  which  almost  by  definition  the  govern- 
ance needs  to  be  flexible  and  adaptable  to  emerging  findings. 

The  purpose  of  this  discussion  is  to  view  one  of  the  three  pilot 
state  programs  through  the  window  of  the  analytical  framework  in  an  attempt 
to  isolate  those  policy-related  elements  that  either  promated  or  hindered 
the  achievement  of  goals  as  explicitly  defined  in  the  state's  proposal  and 
as  implicitly  developed  during  the  program.     Such  knowledge  should  lead 
policymakers  at  the  local,   state,   and  federal  levels  to  additional  criteria 
useful  in  future  program  design. 

As  with  the  other  case  studies,   this  inquiry  was  conducted  as  a  test 
of  the  analytical  framework;  no  conclusions  should  be  drawn  from  this 
material  other  than  those  concerning  the  degree  of  coherence  and  organiza- 
tion that  the  framework  gives  to  the  substance  of  the  material  gathered. 
The  analyses  were  based  on  a  systematic  application  of  the  analytical 
framework  to  the  results  of  three  days  of  interviewing  and  to  the  written 
documents  accumulated  during  that  time;  the  results  are  therefore  rather- 
limited  in  scope.     A  comprehensive  study  would  have  required  more  inter- 
viewing, data  gathering,  and  detailed  analysis  than  resources  permitted. 

IX-1 


However,  a  detailed  analysis  of  the  Pilot  State  Dissemination  Program 
(PSDP)  is  available  in  the  evaluation  sponsored  by  the  U.S.  Office  of 
Education  (USOE).  (Sieber  et  al.,  1972)     and  in  a  report  written  by  the 
South  Carolina  PSDP  Director  (Ellis,  1973). 

This  presentation  has  two  major  parts.     The  first  formally  outlines 
the  cyclical  process  that  was  used  in  studying  the  topic  (see  Section  IV). 
The  second  is  a  narrative  of  the  South  Carolina  case  as  it  might  be 
written  for  presentation  to  some  authority  (see  Section  V). 


A  bibliography,  including  references  cited  in  this  case  study,  is 
appended  to  this  report. 
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II    SUCCESS  OF  THE  ANALYTICAL  FRAMEWORK  IN  THIS  CASE  STUDY 


The  purpose  of  this  case  study  was  to  test  the  ability  of  the  ana- 
lytical framework  to  identify  those  policy-related  elements  that  either 
promoted  or  hindered  the  achievement  of  explicit  or  implicit  program 
goals.    We  believe  the  framework  to  be  eminently  successful  in  this 
purpose  on  topics  such  as  the  Pilot  State  Dissemination  Program,  We 
believe  that^  even  with  the  minimal  time  and  resources  spent  on  this 
case  study^  we  quickly  identified  the  crucial  issues. 

Furthermore^  we  feel  qualified  to  make  the  following  recommendations 
and  observations  to  the  staff  of  USOE  and  to  state  agencies: 

•  Policies  should  be  written  to  expand  "areas  of  freedom^" 
rather  than  to  delineate  boundaries  on  action, 

•  Flexibility  should  be  permitted  in  request  for  proposal  (RFP) 
guidelines  if  such  flexibility  leads  to  a  closer  match  with 
state  and  local  needs  or  existing  plans, 

•  A  program  will  be  beneficial  if  each  member  of  the  key  pro- 
gram staff  is  given  a  respectable  degree  of  freedom  in  mating 
the  program  with  individual  needs,  . 

•  A  program  is  more  likely  to  find  a  secure  foothold  within 
the  SEA  after  federal  funding  discontinues  if  a  clear  link 
has  been  shown  with  SEA  future  plans  and  future  financial 
capabilities, 

•  Programs  are  not  run  principally  by  formal  policies^  but 
rather  by  politically  and  economically  aware  persons  who 
establish  informal  policies  to  find  the  most  appropriate 
way  of  proceeding  before  establishing  formal  policies* 

•  A  program  will  find  its  way  through  the  political,  economic, 
and  bureaucratic  maze  if  its  key  staff  consciously  utilizes 
the  political,  economic,  and  bureaucratic  context  surrounding 
the  program.     Such  conscious  activity  should  be  required  of 
program  officers  in  every  contract, 
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Sensitivity  to  cultural  differences  among  states  is  neces- 
sary^ as  such  differences  might  be  reflected  in  submitted 
proposals. 

In  program  evaluation^   a  superficial  examination  may  not  be 
enough.     Weeks  of  active  participation  may  be  necessary  to 
comprehend  reasonably  well  what  is  actually  occurring.  The 
analytical  framework  as  a  tool  for  evaluation  and  comparison 
is  excellent  for  systematically  organizing  large  amounts  of 
information;  however,  caution  should  be  exercised  in  estab- 
lishing the  bases  and  criteria  on  which  the  evaluation  is  to 
be  made,   since  the  framework  does  not  make  them  evident. 


Ill    BACKGROUND  OF  THE  PILX)T  STATE  DISSEMINATION  PROGRAM 


In  1970,  USOE  issued  an  RFP  outlining  a  Pilot  State  Dissemination 
Program  that  was  designed  to  assist  State  Education  Agencies  (SEAs)  in 
improving  educational  practice  and  in  helping  Local  Education  Agencies 
(LEAs)  install  tested  innovations  and  programs.     For  some  time  USOE  had 
been  developing  sources  of  information  useful  to  educators.     The  PSDP 
grew  from  a  recognition  that  innovative  ideas  suggested  by  such  informa- 
tion were  not  finding  their  way  into  practice-- indeed,   that  there  might 
need  to  be  active  promotion  of  this  material.     The  Office  of  Ediication 
wanted  to  determine  whether  information,  retrieved  in  a  clean,  effectively 
edited  format  and  then  hand  carried  to  educators,  would  ensure  sufficient 
utilization.     This  idea  was  directly  modeled  on  successful  attempts  by  the 
Department  of  Agriculture  to  inform  farmers  of  new  methods  through  agri- 
cultural extension  agents  (Rodgers  and  Shoemaker,  1971).  ^ 

The  RFP  (see  appendix  in  Sieber  et  al.,   1972)  required  that  the  state 
initiate  a  team  effort  diregted  from  a  high-level  administrative  position 
within  the  SEA  of  the  participating  states.     A  staff  was  to  retrieve  in- 
formation from  the  Educational  Resource  Information  Center  (ERIC)— a 
computerized  source  of  information  developed  with  USOE  funds  during  the 
1960s-- and  pass  it  on  to  the  field  agents,  who  in  turn  would  pass  it  on 
to  educators  commensurate  with  their  needs. 

Three  states  won  funding  to  develop  the  three-year  program.  Tech- 
nical assistance  came  from  the  University  of  Missouri,  and  a  detailed 
evaluation  was  done  by  Columbia  University  (Sieber  et  al.,  1972). 
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IV    METHOD  AND  INTERIM  RESULTS 


The  framev/ork  tested  consists  of  the  five  steps  described  in  the 
main  volume  of  this  study.     For  completion^   this  particular  case  study 
required  three  full  cycles  of  the  framework's  first  four  steps.  Each 
cycle  is  here  referred  to  as  a  **round'*: 

•  Round  I :    Preinterview  work  » 

•  Round  II:    Postinterview  work 

•  Round  III:    Final  analysis  and  write-up. 

Only  the  results  of  the  work  associated  with  each  step  within  each 
round  are  included  in  the  following  pages.     It  should  be  emphasized  that 
use  of  the  analytic  framework  requires  creativity  and  reflection,   as  does 
use  of  any  method  of  inquiry.     Such  inputs  are  essential  to  exploit  fully 
the  potentials  of  the  methodology. 

Round  I:     Preinterview  Work 

In  the  _b eg inning,  the  research  team  found  the  topic  nebulous,  at 
best.     All  information  necessary  for  developing  the  initial  skeletal  struc- 
ture of  the  analysis  as  dictated  by  the  framework  came  primarily  from  the 
grapevine  and  the  literature.     The  first  four  steps  were  fleshed  out  with 
the  following  material. 

Step  1:     Identifying  the  Purpose  of  Our  Inquiry 

The  policy  environment  of  the  federally  funded  PSDP,   1970-73,  was 
to  be  considered  for  two  reasons:     to  document  policies  that  dealt  with 
the  establishment  and  governance  of  the  programs  in  the  selected  states, 
and  to  isolate  those  policies  significant  to  the  achievement  of  the  goals 
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of  the  states'  respective  programs.     Such  knowledge  might  well  lead  to  a 
clearer  understanding  of  the  policymaking  pr^ocess  and  to  new  criteria 
useful  in  establishing  better  educational  programs  at  the  federal^  state, 
and  district  levels. 

USOE's  1970  RFP  was  the  obvious  source  for  finding  USOE's  opinion 
on  the  goals  of  this  program.     Essentially  it  was  designed  to  assist  SEAs 
in  accelerating  the  improvement  of  educational  practice  and  the  installa- 
tion of  tested  innovations  and  programs  by  local  school  districts.  The 
basic  structure  was  seen  as  a  program  team  consisting  of  a  director, 
reference  and  retrieval  staff,   and  field  agents.     Special  emphasis  rested 
on  testing  the  field  agent  idea. 

Step  2;     Identifying  the  Focus  of  Inquiry 

The  primary  focus  of  analysis  was  the  educational  extension  field 
agent,   a  person  intended  by  the  federal  agency  to  be  the  means  of  dis- 
tributing innovative  educational  material.     All  policies  that  impact  on 
the  agent  were  studied  within  a  local  "field  of  analysis"  that  included 
the  influences  principally  of  the  SEA,  other  state  government  agencies, 
and  the  LEAs.     The  analytic  framework  required  the  development'  of  a 
mapping  scheme  to  show  these  influences  more  explicitly.    Figure  IX- 1 
identifies  the  field  and  the  focus  of  analysis,  the  actors,   and  the  lines 
along  which  policies  move. 

Step  3;     Identifying  the  Key  Conf iguratlonal  Elements 

This  step  sought  to  distinguish  four  fundamental  elementis  of  every 
policy  question:    who  the  involved  actors  were,  which  resources  they  had 
at  hand,  what  policies  they  set  or  complied  with,  and  in  which  activities 
they  participated.     Table  IX- I  was  the  first  attempt  at  detailing  these 
elements. 
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Table  IX- 1 
THE  FOUR  CONFIGURATIONAL  ELEMENTS 


Actors 

Proposal  writers;  SEA  and  LEA  administrators,  especially 
program  administrators;  reference  and  retrieval  special- 
ists; computer  operators;  field  agents;  secretaries  and 
staff;  legislators;  judicial  and  executive  members; 
teachers;  and  teachers'  union. 

Policies 

Policies  are  statements  that  define  the  direction  of  the 
program;  some  policies  carry  the  force  of  law,   some  do 
not,  yet  the  latter  are  adhered  to  because  they  spring 
from  responsible  authority. '  In  particular: 

Policy  Setters     to  ^         Policy  Compliers 

State  government  SEA 

Actors  within  SEA  ^  Other  actors  within  SEA 

via  program       „  .  ^ 
SEA  —  ^  Field  agents 

SEA  ^  LEA 

LEA^  ^  Field  agents 

LEA  '•  ►  Teachers 

SEA  ^  Teachers 

Resources 

Funding  and  allocation;  information  sources;  and  materials 
and  products  from  educational  concerns,  including  Mini- 
courses,  textbooks,  audiovisual,  and  television. 

Activities 

Activities  of  importance  focus  principally  on  establishing 
and  continuing  the  program  (proposal  writing,  choosing 
personnel,  communicating  within  SEA,  and  the  like).  Ac- 
tivities are  performed  by  individuals  with  specific,  func- 
tioning roles.    They  include  duties  and  tasks  as  outlined 
by  formal  and  informal  policies.     In  particular,  activi- 
ties are  performed  by  the  SEA,   the  program  staff,  the 
agents,  teachers,  the  LEA,  and  the  state  government. 
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step  4:     Image  Development  of  the  PSDP  Structure  and  Its  Environment 

Extensive  preliminary  diagrams  were  drafted  to  refine  the  initial 
focus  and  field.     The  first  (Figure  IX-2)  attempted  to  make  the  study 
more  comprehensive  by  visualizing  every  conceivable,   influential  factor. 
Four  fields  of  complexity  (LEAs,  SEAs,  USOE,  and  the  federal  government) 
appeared  to  interact  closely;  yet,  at  the  same  time,  each  maintained  its 
autonomy.     Policies  generated  at  the  local  level  often  occurred  in  re- 
sponse to  state  policies,  which  responded  in  turn  to  federal  suggestions 
from  USOE.     The  latter  is  the  direct  extension  arm  of  the  federal  law- 
makers. 

Figure  IX- 2  says  that  the  individual  unit  of  focus  within  the  field 
communicates  with  concerned  groups  over  internal  networks,     A  physical 
environment  surrounds  all  entities;  the  systemic  environment  is  the  eco- 
nomic and  political  situation.     All  five  elements  change  over  time, 

^    This  general  diagram  was  expanded  to  substantial  detail  on  each 
field  of  complexity.     Figures  IX-3  through  IX-6  show  each  field  as  it 
existed  during  the  1970-73  program.     The  arrows  represent  the  paths  along 
which  policy  moved;  in  most  cases  these  were  not  known,  but  only  suspected. 
Indeed,   the  interviews  made  clear  that  a  substantial  percentage  of  the 
potential  paths  had  never  carried  any  formal  policies  or  laws. 

Table  IX- 2  was  generated  in  response  to  time  changes.     It  is  a 
rudimentary  history  of  the  PSDP  as  seen  from  the  federal  level. 

This  mapping  scheme  made  the  codification  procedure  for  formal 
policies  quite  straightforward.     The  upper  right-hand  corner  of  each 
worksheet  (Table  IX-3)  was  marked  with  three  items;  the  first  gave  the 
field  name,  that  is,  the  U,S,   government  (USG),  USOE,  SEA,  or  LEA;  the 
second,   the  year  during  which  this  policy  was  created;  the  third,  the 
path  along  which  the  policy  of  that  worksheet  moved,     A  numbering  system. 
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Table  IX- 2 


AN  HISTORICAL  OVERVIEW  OF  THE  PILOT  STATE  DISSEMINATION  PROGRAM 


1965 

ESEA  is  made  into  law  (PL  89- 10), 

1969 

The  Commissioner  of  Education,  James  Allen,  states 
that  the  first  goal  of  USOE  ought  to  be  to  "develop 
a  nationwide  strategy  for  maintaining  a  continuous 
process  of  improvement  and  relevance  in  American 

pdllca^^  on  " 

Fall  1969 

USOE  sponsors  a  national  meeting  to  examine  informa- 
j-^ii        Dt^iiixiidi. xuii  tJi. xur t b  wxcnxn  cne  s t aces • 

May  1,  1970 

Responses  to  the  RFP  from  USOE  Office  of  Dissemina- 
tion are  due.     RFP  calls  for  three  states  to  study 
the  program  under  the  name  "Pilot  Dissemination  Pro- 
grdiiu       inree  scaces  will  receive  yOU,  UUU  to  yiUU,  UUU 
to  set  up  the  program;  an  outside  agency  will  moni- 
tor, train  the  extension  agents,  and  evaluate. 

July  1,  1970 

South  Carolina  is  one  of  the  three  states  chosen. 
Columbia  University  is  to  do  the  evaluation. 

1970 

The  National  Center  for  Education  Commission  (NCEC) 
within  the  USOE  is  established  and  becomes  the  focus 
for  dissemination  and  the  RFP.     NCEC  funds  the 

pi.  UJ cL- L  . 

Novpmhpr  Q  1Q71 

iiie  rirsL  iNauionai  Lionrerence  on  uis semination  is 
sponsored  by  South  Carolina  in  St.  Louis,  Missouri. 

Mav  1972 

xLic  occuLiu  LrL/iijL t; tt;iiL»e  lb  ne lu  in  LiOiumuia,  doullI 
Carolina. 

August  1972 

NIE  takes  over  NCEC's  role. 

February  1973 

The  third  conference  is  sponsored  by  South  Carolina 
in  Maryland. 

September  1972 

Sieber  and  colleagues  complete  their  evaluation. 

1973 

A  variety  of  states  are  funded  by  USOE  for  their  own 
programs. 

1973 

South  Carolina  completes  the  evaluation  of  its  own 
program. 
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ERLC 


conimon  to  both  the  schematic  and  the  worksheet,  made  evident  the  path  on 
the  diagram  to  which  the  policy  corresponded. 

The  results  o£  Round  I  established  the  basis  for  a  sound  analysis 
of  the  PSDP.     Significant  gaps  in  knowledge,  which  only  interviews  could 
fill,  were  sprinkled  throughout  the  analytic  structures  (Figures  IX- 3 
through  IX-6).    The  obvious  preparation  for  these  interviews  was  the  de- 
velopment of  questions  (see  Table  IX-4)  to  fill  these  gaps.    For  example. 
Lines  5a  and  5b  of  Figure  IX-5  suggested  that  a  handbook  or  other  form 
of  guideline  might  have  been  generated  for  use  in  the  program.     Such  would 
have  been  a  source  of  policies  for  our  study.     This  idea  generated  Ques- 
tion (2),  Field  III,   in  Table  IX-4. 

Round  II;    Postinterview  Work 

After  interviews  were  completed.  Round  I  efforts  were  reviewed  and 
a  large  number  of  documents  were  cataloged  and  studied.     As  each  step  for 
Round  II  was  completed,  it  either  verified,  modified,  or  amplified  Round 
I  results. 

Step  1:    Refining  the  Purpose  of  Analysis 

Our  purposes  for  this  case  study  were  modified  slightly  in  response 
to  field  experiences.    They  became: 

•  To  isolate  those  PSDP  policies  essential  to  the  achievements 
of  the  state's  explicit  and  implicit  program  goals. 

•  To  document  those  policies  and  to  understand  the  historical 
development  of  the  policymaking  process  in  terms  of  the 
actors,  policies,  resources,  and  activities. 

Study  of  interview  materials  and  of  newly  supplied  literature  re- 
vealed essentially  little  difference  between  the  goals  sought  in  practice 
and  the  goals  stated  in  the  1970  proposal. 
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Table  IX-4 
QUESTIONS  GENERATED  FK(M  THE  DIAGRAMS 


I 

Fields  I  and  II:    Focus  on  the  U.S.  Government  and  USOE 

(1)  Time  development:    What  were  the  agencies  that  worked  initially  with  the  dissemination? 
How  have  those  agencies  and  the  NIE  structure  changed  over  time?     (This  will  determine 
those  people  and  groups  concerned  with  dissemination  who  might  have  issued  policies.) 

(2)  What  are  the  PSDP  guidelines  for  education  dissemination?    In  particular,  which  are  written 
specifically  for  the  agent?    Changes  over  time? 

(3)  To  what  extent  do  the  NIE  and  other  U.S.  government  agencies  affect  state  education  with 
regard  to  dissemination? 

(4)  Through  which  branches  of  U.S.  government  might  policies  come  to  influence  the  NIE,  HEW, 
and  USOE  that  may  affect  dissemination  and  the  agent  program?    Which  U.S.  government  agen- 
cies most  closely  influence  education  in  the  United  States?     (This  will  suggest  places  to 
look  for  major  policies.) 

Field  III:    Focus  on  the  SEA 

The  agent  himself  resides  within  Field  III,  complying  directly  with  SEA  and  LEA  policies.  In- 
directly he  feels  the  brunt  of  other  policies  stemming  from  federal  as  well  as  state  government. 

(1)  What  is  SEA  structure?     (This  will  help  clarify  who  sets  the  direct  policies  on  the  agent 
and  who  complies  with  the  indirect  or  state  policies.)    Did  It  change  over  time? 

(2)  What  guidelines  have  been  established  for  the  general  dissemination  program?    What  has  been 
its  history?     (This  will  reveal  the  overt  structure  of  the  program.) 

(3)  What  was  the  governing  structure  of  the  program,  hierarchically  above  and  below*the  agent? 
(This  presents  an  idea  of  who  would  generate  covert,  implicit  policy.) 

(4)  SEA  structure  would  also  give  an  idea  of  which  state  government  branch  would  issue  state 
educational  policy  enforceable  on  SEA.    How  does  the  state  make  educational  policy?  (Which 
agency,  what  parts  of  the  code  are  applicable,  and  the  like?) 

(5)  What  requirements  must  the  agent  possess?     (Must  he  be  credentialed  or  part  of  Civil  Ser- 
vice?)    (This  will  lead  to  more  policies.) 

(6)  Are  there  any  court  cases  or  attorney  general  opinions  on  educational  dissemination?  (This 
will  lead  to  further  state  government  influence,) 

(7)  Under  what  limitations,  particularly  economic,  do  the  SEA  and  the  dissemination  program 
work?    What  percent  of  the  state  budget  goes  to  higher  education?    (This  is  another  type  of 
policy  that  makes  a  program  go  or  not  go, ) 

(8)  What  percentage  of  the  program  budget  came  from  USOE?    From  SEA?    Changes  over  time? 

Field  IV:    Focus  on  the  LEA 

(1)  What  types  of  LEA  guidelines  are  of  general  concern  to  an  outsider  of  the  LEA,  such  as  an 
extension  agent?    Is  there  enforcement  as  to  the  participation  of  agents  in  the  classroom? 
How  might  the  agent  be  aided^ or  hindered  in  his  chores  by  the  LEAs?  Change*  over  time? 

(2)  What  is  the  structure  of  target  schools?    (This  will  determine  who  and  through  what 
mechanism  policies  might  come« ) 

(3)  Under  what  economic  and  physical  limitations  do  the  LEAs  work  with  respect  to  the  agent 
program?    What  percentage  of  teachers'  budget  is  allocated  to  dissemination  and  knowledge 
acquisition  via  the  agent? 

(4)  Which  people  in  LEA  interact  with  the  SEA  so  that  suggested  SEA  policies  are  implemented  in 
the  LEA?    How  do  the  federal  and  state  agencies  enforce  suggeationi  that  they  make?  (Sug- 
gestions often  become  policies,  if  forced.) 
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South  Carolina  had  expected  to  design  processes  to  accelerate  the 
improvement  of  educational  practices.     This  would  be  accomplished  through 
providing  access  to  and  encouraging  use  of  research  information  leading 
to  the  installation  of  tested  innovations  and  programs  within  a  definite 
framework  operated  by  local  school  districts  (Ellis^  1970). 

The  PSDP  purposes  in  South  Carolina  embodied  the  basic  USOE  concepts: 
that  educators  should  be  aided  in  receiving  and  using  information  to  make 
better  decisions  for  the  improvement  of  educational  practices^   and  that 
a  field  agent  should  extend  personal  services  in  the  dissemination  effort. 
South  Carolina,  moreover,   intended  the  program  to  influence  local  adminis- 
trators, as  well  as  teachers.     A  computer-based  center  was  to  provide  the 
access  to  this  information,  which  included,  but  was  not  limited  to,  the 
ERIC  system. 

Step  2;    Refining  the  Focus  and  Field  of  Analysis 

The  focus  of  analysis  shifted  from  the  field  agent  to  the  PSDP  team 
within  the  SEA;  it  became  evident  early  in  the  interviewing  process  that 
policies  emanating  from  the  PSDP  team  dominated  the  policy  scene. 

The  role  of  the  field  agent,  though,  had  become  much  clearer  following 
the  interviews.     South  Carolina  placed  emphasis  on  the  development  of  a 
locally  based  staff  that  would  eventually  handle  the  work  of  the  field 
agent.     Evidence  of  such  existed  in  the  statement  of  purpose  of  their 
initial  proposal.     There  existed  an  intense  sensitivity  for  the  local 
governance  structure  of  education,  mostly  because  of  the  traditional 
emphasis  on  decentralization  in  the  culture  of  that  state.     From  the  be- 
ginning, the  PSOP  staff  knew  that  no  activity  in  which  the  team  engaged 
should  ever  be  construed  to  mean  undue  SEA  stress  on  local  educators  if 
the  program  was  to  be  accepted  in  the  state;  therefore,  they  had  to  make 
the  program  a  part  of  the  LEA  structure  itself. 
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Over  time^   as  clearer  roles  for  all  actors  evolved^  the  decision 
was  made  to  pull  the  agents  into  regional  ("area")  boundaries^  while 
they  trained  and  assisted  the  district  representatives  who  replaced  them. 
By  the  beginning  of  the  third  year^  the  field  agent  was  gone;  in  effect, 
the  position  had  been  used  to  institutionalize  a  locally  based  dissemina- 
tion structure.     As  expressed  in  the  RFP,  such  was  not  the  intent  of  USOE. 
The  agent  was  not  to  be  removed,  but  rather  incorporated  into  the  system 
if  proved  an  asset  in  the  dissemination  process.     When  South  Carolina 
found  the  idea  of  an  agent  advocating  change  to  be  unworkable,  the  con- 
cept needed  to  be  clarified  with  USOE  before  funding.     Indeed,  discussions 
between  USOE  and  South  Carolina's  Chief  State  School  Officer  (CSSO)  along 
this  line  were  profitable  while  the  proposal  was  being  written. 

Step  3:     Refining  the  Four  Configurational- Elements  in  Detail 
The  elements  discovered  in  Round  I,  Step  3,  are  detailed  below. 

Conf igurational  Element:  Actors 

•  Dr.  W.  E.  Ellis;    Director  of  the  Office  of  Research 
and  Planning  engaged  in  the  five-year  plan  development. 
Dr.  Ellis  wrote  the  1970  proposal.    He  had  worked  pre- 
viously in  USOE  and  in  several  South  Carolina  districts 
before  becoming  Program  Administrator,   along  with  his 
other  duties.     He  chose  the  Chief  Supervisor  to  handle 
the  daily  operations  of  the  PSDP  and  with  her  wrote  the 
continuation  proposals  and  final  report.    He  became 
Director  of  the  Educational  Products  Center  (EPG), 
which  disseminates  all  information  for  the  state  educa- 
tion system. 

•  Dr.  Diana  Ashworth;    Hired  as  Chief  Supervisor  to  work 
under  Dr.  Ellis.    Two  years  after  program  initiation, 
she  became  Director  of  the  Office  of  Planning,  her 
present  position. 
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•  Mr«  Al  Evans;    Field  agent  for  the  Charleston  district; 
a  former  school  principal^  knowledgeable  of  district 
affairs  and  personnel;  was  Chief  Supervisor  for  the 
last  six  months  of  the  program  in  1972, 

•  Dn  Cyril  Busbee:    Superintendent  (CSSO)  in  1970;  re- 
elected in  1974;  an  original  supporter  of  the  dissemina- 
tion concept. 

•  Mr*  Jesse  Coles;    Deputy  Superintendent  of  Administration 
and  Planning;  Dr.  Ellis'  immediate  superior. 

•  Ms.  Eilene  Folger;    A  retrieval  specialist;  part  of  the 
original  team  at  the  Center;  held  an  M.A.  degree. 

Conf igurational  Element;  Resources 
Funding  is  as  follows; 

•  1970-73;  USOE 

•  1973-75;    State  funds  and  district  funds 

•  1975-     ;    USOE  granted  funds  for  capacity  building. 

Configurational  Element;  Policies 
The  formal  policies  are  as  follows; 

•  USOE   ^  SEA;  RFP. 

•  Policies  within  U.S.  government. 

-  Public  laws. 

-  Busing,  desegregation  laws  (1964)  (Title  VI  of  the 
Civil  Rights  Act).  Assurance  of  compliance  signed 
in  1971  by  Mr.  Jesse  Coles. ^  ^ 

•  Policies  within  South  Carolina  state  government:  South 
Carolina  Code  of  Laws.  Vol.  5,  Title  21,  also  Vol.  17. 

•  Policies  within  SEA.  , 

-  A  guide  for  operationalizing  the  11  objectives  (1970). 

-  Proposal  for  "State  Dissemination  Grants  Program" 
(1975). 


-  Defined  minimum  program  (1974). 

-  Five-year  plan  (1970,  updated  yearly). 

•  Policies  within  program. 

-  Initial  proposal,  continuation  proposals,  and  final 
report. 

-  Progress  report  objectives  (A),  (B),  (D),   (G),  and 
(H). 

-  Proposed  organization  and  administration  of  EPC  (1975). 

-  Progress  report  objectives  (E)  and  (F). 

-  Memorandum  agreement  with  USOE. 

•  Program   »-LEA:     Progress  report  objectives  (C). 

•  LEA   ^  agent :     Personnel  policies  manuals  [see  South 

Carolina  School  Board  (SCSB)  and  Charleston  manuals]. 

•  LEA  ^  teachers:     Personnel  policies  manuals  (see 

SCSB  and  Charleston  manuals). 

•  SEA   ^teachers:    Defined  minimum  program  (1974). 

The  informal  policies  are  as  follows: 

•  Policies  within  SEA  - 

-  A  strong  push  was  on  to  make  everyone  on  every  level 
accountable  for  some  critical  aspect  of  education 

in  South  Carolina  (initial  proposal,  interview). 

-  Previous  activities  had  an  opening  for  the  dissemina- 
tion program  [Basic  Education  Data  Services  (BEDS), 
five-year  plan,  11  objectives] .     The  concept  was  al- 
ready existent;  what  could  be  better  than  this  RFP 

to  continue  the  idea?  (observation). 

-  The  state  was  moving  in  1970  toward  a  system  of  de- 
cision making  based  on  problem-area  priorities  and 
needs  assessment  and  a*  strong  information  service 
(observation). 

•  USOE   ►  SEA  and  program 

-  Contact  with  USOE  had  been  established  when  the  pro- 
gram was  in  its  planning  stages  in  USOE  (interview). 
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-  The  1970  proposal  and  a  memorandum  agreement  with 
USOE  intended  a  test  of  the  extension  agent  concept 
and  a  deep  penetration  of  the  dissemination  concept 
into  the  daily  routine  of  the  educational  process 
(interviews;  initial  proposal,   1970,  p#  6), 

-  USOE  manager  responded  openly  to  changes  in  the  basic 
RFP  idea,  since  the  whole  concept  was  new  and  unproved; 
he  gave  full  flexibility  (interview), 

•  Policies  within  EPC 

-  The  EPC  intended  to  shake  up  the  SEA,  that  is,  to 
motivate  agencies  to  cooperate,  reach  out,  and  pro- 
mote improvement  and  accountability  and  to  motivate 
LEAs  to  reach  out  for  ideas  and  share  successes 
(interview). 

♦ 

-  The  EPC's  purpose  was  to  extend  and  reshape  dissemina- 
tion.    Conununication  between  local,  state,  and  national 
agencies  concerning  educational  products  has  remained 
until  now  a  loosely  coordinated  and  ineffective  process 
("State  Dissemination  Grants  Program,"  1975,  p.  1). 

•  Policies  within  PSDP 

-  Initial  viewpoint  was  that  information  is  for  a  pur- 
pose (observation) • 

-  Director  worked  on  the  principle  that  informed  de- 
cisions are  likely  to  be  better  decisions  (observa- 
tion). 

-  The  central  dissemination  of  information  was  viewed 
as  the  best  use  of  limited  resources  available  to 
all  (observation) • 

-  At  present,  the  greatest  concern  to  the  Director  is 
the  utilization  of  these  products  once  they  are  de- 
livered (observation).  , 

-  The  information  delivered  must  be  directly  useful  and 
on  time  (interview). 

-  Each  retrieval  specialist  and  field  agent  was  re- 
quired to  have  master's  degree.     The  Chief  Supervisor 
was  to  have  a  doctorate  (initial  proposal,  1970,  pp. 
10-11). 
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•  Policies  within  the  PSDP 

-  The  broad  objectives  of  the  program  were  to  facili- 
tate dissemination,   applications,  and  utilization  of 
educational  research;  to  encourage  improvement  and 
constructive  change  in  the  educational  process;  to 
develop  and  operate  an  information  retrieval  and  dis- 
semination center;  and  to  develop  and  operate  a  field 
component  to  assist  the  utilization  of  educational 
information  (Ashworth  et  al.,   1972,  p,  11), 

-  Three  times  it  was  mentioned  in  the  continuation  pro- 
posal that  the  PSDP  intended  the  SEA  to  assume  leader- 
ship in  the  development  and  operation  of  an  information 
service  to  assist  educational  managers  and  practitioners 
(second-year  proposal). 

-  The  continuation  proposal  described  well  in  advance 
what  was  going  to  happen;  the  proposal  made  explicit 
the  intent  and  steps  needed  for  strong  institutional- 
ization, particularly  of  how  the  program  was  to  become 
imbedded  in  LEA  structure  (second-year  proposal,  p. 
32). 

-  The  Director  of  Research  and  Planning  remained  well 
on  top  of  PSDP  affairs.    He  was,   in  essence,  the 
direct  link  to  higher  SEA  management  and  the  direct 
route  in  the  flow  of  life  sources  from  the  CSSO  him- 
self (observation). 

-  The  Deputy  Superintendent,  immediate  superior  of  the 
Director  of  Research  and  Planning,  remained  close  to 
the  program  and  supported  it.    That  the  program  became 
entrenched  so  strongly  in  SEA  affairs  after  1970  was 
largely  because  of  his  efforts  (interviews). 

•  Program   ^  agent 

-  Emphasis  was  oh  incentive  rather  than  restriction. 
The  individual  was  made  to  feel  a  part  of  the  enter- 
prise.   Formative  evaluation  was  we  11- programmed 
into  the  communication  links  within  the  system  (in- 
terview, observation). 

.    -  The  concept  of  the  agricultural  extension  agent  was 
set  aside  when  it  was  realized  that  information  on 
new  classroom  techniques  was  not  like  information  on 
new  ways  to  grow  bigger  and  better  potatoes;  the 
potatoes  would  grow  bigger  and  better,  but  the 
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education  of  students  was  dependent  on  internal  fac- 
tors of  the  classroom  rather  than  controllable  factors 
like  climate  (interview). 

-  Agents  were  communication  specialists  rather  than  in- 
formation specialists  (Ashworth  et  al.,  1972). 

-  The  agent  must  not  anticipate  or  interpret  what  is 
''good"  for  the  client  (observation^  interview). 

-  The  communication  specialist  is  not  a  "change  agent" 
or  Cuba's  "diffusion  agent."    He  provides  no  solutions 
to  operating  problems.     First  he  attempts  a  diagnosis 
of  the  problem^  to  perceive  the  real  problem. 
Havelock's  "catalyst"  or  "process  helper"  models  would 
be  more  attuned  to  South  Carolina's  case  (Ashworth 

et  al.,   1972,  p.  40;  Cuba  and  Clark,  1974;  and 
Have lock,  1971). 

-  "The  primary  purpose  of  Research  Data  supplied  to  you 
is  not  to  effect  change  but  rather  to  increase  aware- 
ness of  problem  areas  and  seek  alternatives  for  their 
resolution"  [brochure  advertising  the  Research  Infor- 
mation Unit  (RIU)  in  its  second  year;  see  Ellis,  1973, 
appendix] .  '  " 

•  LEA   ^  agent 

-  The  agent's  role  in  the  district  was  adjusted  to  meld 
rather  than  compete  with" the  entrenched  information 
specialists  (interview). 

-  Sixty-three  LEAs  chose  representatives  to  facilitate 
communications  between  their  districts  and  the  RIU 
("Quarterly  Progress  Report,"  January-March  1972). 

Conf igurational  Element:  Activities 

•  pspp 

-  The  SEA  administration  was  sensitive  to  the  differences 
in  intent  between  their  ideas  and  USOE^S  ideas  con- 
cerning the  project.    The  CSSO  consequently  spoke  with 
USOE  on  the  matter  and  received  approval  to  proceed 

as  they  wished  (interview). 
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The  Director  defined  policies  as  tools  to  use  in  de- 
fining his  "areas  of  freedom";  it  was  a  philosophy 
that  did  not  restrict  his  movements  (interview). 

Enthusiasm  and  commitment  from  the  staff  were  evident 
from  the  beginning  (Ashworth  et  al.,  1972,  p.  24). 

ESEA  Title  IV,  Section  402,  was  initially  to  be  used 
for  the  development  of  a  "data  collection  unit" 
(initial  proposal,  'p.  13). 

There  was  good  communication  and  good,  strong  leader- 
ship at  the  highest  level  of  authority  (interview). 

The  Chief  Supervisor  had  captured  the  confidence  and 
respect  of  all  participants;  she  provided  the  human 
balance  to  the  program.     The  Director  was  the  authori- 
tarian SEA  official;  the  Supervisor  was  the  calm, 
easy-to-work-with  newcomer  to  the  SEA.     It  was  the 
balance  of  the  two  that  made  the  SEA  stable  (observa- 
tion). 

The  PSDP  must. have  a  stable,  capable  central  staff. 
Feedback  from  the  field  agent  maintained  enthusiasm 
within  the  staff  (interview). 

The  retrieval  specialists  were  well-educated  and  held 
master's  degrees,  a  policy  that  eventually  moved  the 
task  out  of  the  clerical  mode  (interview).  ^ 

Processing  priority  at  the  Retrieval  Center  was  given 
to  the  field  agents.     Follow-up  and  on- time  processing 
were  considered  as  most  important  (interview). 

Quarterly  progress  reports  kept  information  flowing. 
Objectives  were  universal  enough  to  continue  as  ob- 
jectives throughout  the  program,  but  specific  enough 
to  be  useful  (observation). 

The  Director  made  politically  key  use  of  the  service 
to  promote  it:    he  prepared  a  package  on  British  in- 
fants schools  that  made  the  CSSO  the  best  informed 
participant  at  an  English  convention;  he  prepared  a 
package  on  all  information  about  the  South  Carolina 
educational  system  for  CSSO's  encounter  with  the 
newly  .elected  state  governor  (interview);  he  made 
clear  ties  with  legislature  and  staff  to  help  supply 
their  information  needs;  he  developed  the  idea  of 
sharply  distinguishing  help  to  the  client  and  in-' 
fluence  on  the  client's  decision;  and  he  provided 
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service  to  State  Board  co?mmittees  drawing  up  five- 
year  plans  (interview). 

The  Director  used  the  Library  of  Congress,  convinced 
ERIC  Central  to  add  South  Carolina  documents,  and 
used  every  structure  engaged  in  dissemination.  Appro- 
priate agencies  were  catalyzed  into  acting  (interview) 

June  1970:    The  Office  of  Research  and  Planning  was 
split  into  two  groups  with  the  Office  of  Research  in- 
corporating three  new  groups:     research,   survey,  and 
the  RIU  in  which  PSDP  was  assigned. 

January  1971:    Requests  in  this  one  month  equaled  the 
total  from  July  to  December  1970  (Ashworth  et  al., 
1972,  p.  28). 

July  1971:     The  Office  of  Research  was  reorganized  int 
three  sections :     research/ statistics,   survey /evalua- 
tion,  and  research  information,  of  which  RIU  was  a 
component  (Ashworth  et  al.,   1972,  p.  13). 

By  August  1971,   195  requests  had  been  submitted  by 
State  Department  of  Education  personnel  (second-year 
proposal,  p.  10). 

A  catalog  was  prepared  in  Fall  1971  of  all  requests 
processed  since  July  1970  (second-year  proposal,  p. 
21). 

By  December  1971,   232  requests  had  come  from  Rock  Hill 
and  239  requests  from  State  Department  of  Education 
personnel  (Ashworth  et  al.,   1972,  pp.  47  and  17). 

By  March  31,   1972,  443  requests  had  been  received  from 
nonpilot  districts,  for  an  overall  total  of  1560 
(^'Quarterly  Progress  Report,*'  1972,  p.  2). 

The  dissemination  cycle  period  in  December  1972  was 
down  one-half  from  five  months  before  (Ashworth  et 
al.,   1972,  p.  31). 

By  June  1973,  3030  requests  had  been  filed  for  target 
and  nontarget  districts  (Ellis,  1973). 

The  RIU  had  developed  its  own  identity  within  the 
Department  of  Education  as  a  result  of  its  ability 
to  deliver  a  usable  product  in  a  reasonable  period 
of  time.     The  Department's  commitment  to  the  utiliza- 
tion of  education  research  information  as  a  basis  for 
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planning  and  development  had  further  integrated  work 
into  the  total  (Ashworth  et  al.,   1972,  p.  18). 

-  The  Director's  final  report  was  packed  with  informa- 
tion on  the  success  of  the  program.    He  quoted 

Dr.  Sieber's  confirmation  of  this,   and  then  described 
the  expansion  of  research  and  dissemination  services 
and  their  extension  into  nontarget  areas  (Ellis,  1973, 
p.  18). 

-  The  Query  program  was  updated  to  cut  search  time  sub- 
stantially (second-year  proposal,   p.  19). 

-  Two  articles  about  the  RIU  appeared  in  South  Carolina 
Schools  magazine  as  advertising  ("Quarterly  Progress 
Report,"  January-March  1972). 

-  Recommendations  for  future  PSDP  programs  appeared  in 
the  final  report  (Ellis,   1973,  p.  3). 

SEA 

-  In  1970  SEA  had:    basic  staff  and  conmitment  to  infor- 
mation services,  but  no  well-established  resources  in 
BEDS;  goals  embodied  in  a  five-year  plan;  and  knowledge 
of  exemplary  practices  in  some  districts  that  they  were 
willing  to  share  (observation). 

-  South  Carolina  came  alive  in  1965;  a  new  CSSO  came 
aboard.    Ninety  percent  of  the  1960  vintage  were  let 
go;  by  1970  CSSO  was  running  smoothly  (interview).. 

-  The  CSSO  maintained  strong  communication  with  govern- 
ment,  superintendents,  and  legislators  (interview). 

-  The  State  Department  of  Education  was  not  a  keeper  of 
district  information.    Districts  were  left  to  them- 
selves.   SEA*s  function  was  to  serve  the  districts 
(interview). 

Districts'  (LEAs) 

-  Rapid  major  changes  were  occurring  in  1970.    The  largest 
were  Civil  Rights  and  busing  problem*s--"separate  but 
equal  schools. People  did  not  want  change.    Rock  Hill 
was  voted  a  large  bond  issue,  which  gave  it  a  lot  of 
new  money.     A  new  Superintendent  came  in^  consolidating 
two  old  districts;  he  wanted  cautious  change.    Use  of 
the  term  ''change  agent"  would  have  scuttled  the  entire 
program  (interview). 


IX- 30 


-  Groundwork  was  laid  before  the  agent  was  introduced. 
Good  working  relations  were  already  established  (in- 
terview). 

-  Conrniitinent  from  the  districts  was  already  established 
before  the  project  was  funded  (interview), 

-  Field  agents  were  appointed,   at  the  suggestion  of  dis- 
trict office,  as  district  staff  (interview). 

-  The  SEA  allowed  the  Superintendent  to  develop  the  role 
of  the  agent.     This  developed  a  trust  that  SEA*s  in- 
tention was  not  to  dominate,  but  to  serve.     The  role 
was  refined,  not  defined  (interview). 

-  Superintendents  were  helpful;  they  aided  the  agents 
and  advertised  the  system  (interview). 

-  Rock  Hill  had  a  28%  black  population,  which  was  in- 
creasing by  47o  every  ten  years,  according  to  the  1970 
census  figures  (Ashworth  et  al.,  1972,  p.  36). 

-  After  funding  was  continued  in  January  1972,  the  com- 
munication specialists  shifted  emphasis  from  their 
target  districts  to  more  expansive  areas.     They  then 
trained  the  district  representatives  who  took  their 
place  (second-year  proposal,  p.  32). 

Educational  Products  Center  (EPC)  (1974  descendant  of  PSDP) 

-  EPC  has  three  roles:    linkage  agent  role,  information 
resource  pool,  and  product  center. 

-  The  EPC  attempts  to  direct  requestors  to  the  agency 
or  district  that  is  the  source  of  information  (inter- 
view). 

-  EPC's  major  value  is  in  preventing  the  state  from  going 
in  the  wrong  direction  rather  than  in  a  so-called 
"right"  direction  (interview). 

-  The  EPC  used  their  Survey  of  School  Statistics  as  an 
incentive  to  get  the  LEAs  accustomed  to  using  their 
services  (interview). 

-  The  EPC  intends:     to  tap  and  blend  existing  resources 
and  services  from  many  agencies;  to  establish  a  cycle 
of  dissemination,  resource  assistance,  and  utilization 
in  response  to  user  needs;  and  to  use  audiovisual  and 
print  media  from  various  sources  to  portray  specific 
concepts  ("State  Dissemination  Grants  Program, "1975, 

p.  18). 
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•  Agents 


-  The  agents  always  informed  superintendents  when  and 
where  they  were  in  the  district  and  what  they  were 
doing  (interview) • 

-  The  agents  came  to  many  briefings  at  the  SEA  to  stay 
informed.     In  this  way  a  strong  information  link  was 
maintained  between  district  superintendents  and  the 
SEA  (interview), 

-  The  Charleston  agent  established  an  advisory  committee 
of  educators  in  the. district  to  help  him  screen  re- 
quests^  set  priorities,   and  assess  needs  (Ashworth 

et  al.,   1972,  p.  58). 

-  The  agents  were  cautious  to  provide  alternatives,  not 
answers,  for  the  educator  (interview). 

Step  4;  Refining  the  Maps  of  the  PSDP  Environment  and  Its  Governance 
Structure 

Round  I  maps  were  found  effective  in  describing  the  governance  struc- 
ture.   A  history  (Table  IX-5)  was  developed  to  help  clarify . time  changes. 

Round  III;    Final  Analysis  and  Write-Up  (Step  5  of  the  Framework) 

Section  V,  which  follows,   is  an  example  of  the  final  product  that 
might  result  from  use  of  the  analytic  framework.     It  is  written  with  the 
intention  of  supplying  answers  to  policymakers  who  wish  to  know: 

•  A  short  history  of  the  program  in  South  Carolina. 

•  Whether  or  not  the  state  reached  the  goals  it  set  for  itself. 

•  Which  policies  played  key  roles  in  aiding  or  hindering 
achievement  of  these  goals. 

•  How  closely  the  original  RFP  approximated  those  policies  that 
did,   in  fact,   aid  achievement  of  the  goals. 

•  The  present  state  of  information  dissemination  in  the  state. 

Section  V  is  written  to  emphasize  the  detachment  that  is  possible 
from  the  terminology  and  the  structure  of  the*  analytic  framework. 
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HISTORY  OF  THE  PILOT  STATE  DISSEMINATION  PROGRAM  IN  SOUTH  CAROLINA 


1964 

Federal  busing  and  desegregation  laws  enacted. 

1965 

CSSO  elected. 

1967 

State  School  Board  statement  of  educational  philosophy  con- 
cerning the  five-year  plan. 

1968 

Needs  assessment  study  completed;  BEDS  well  into  development. 

Early  19  70 

Rock  Hill  district  in  great  change;  problems  over  desegrega- 
tion; district  consolidated  from  two  smaller  districts;  new 
bond  issue  voted  in;  new  superintendent  elected;  peop^le  tired 
of  so  much  movement. 

May  1970 

Five-year  plan  adopted;  initial  proposal  written. 

June  1970 

Office  of  Research  and  Planning  split;  RIU  made  component  of 
Office  of  Research. 

July  1970 

Project  funded;  pilot  district  Charleston  and  Rock  Hill;  hiring 
of  personnel  began. 

September  1970 

A  guide  written  by  Director  of  PSDP  for  operationalizing  the  11 
objectives  of  the  five-year  plan. 

Late  1970 

Changeover  to  Query  Retrieval  Software  Program. 

July  1971 

Office  of  Research  became  three  groups;  RIU  within  Research 
Information  Section. 

Fall  1971 

Catalog  of  requests  received  to  date  was  prepared. 

November  1971 

Continuation  proposal  was  written. 

January  1972 

Two  articles  about  RIU  appeared  in  magazines;  RIU  made  avail- 
able to  Winthrop  College. 

July  1972 

Area  specialists  being  developed;  original  agents  were  now 
serving  many  districts  (districts  appointed  representatives). 

September  1972 

Columbia  University  completed  evaluation. 

Late  1972 

Chief  Supervisor  became  Director  of  Planning  Office  in  SEA;  one 
of  the  field  agents  replaced  her. 

January  1973 

Continuation  proposal  written. 

July  1973 

Federal  funding  ended;  funds  from  SEA  continued  project;  RIU 
moved  into  Office  of  Planning  and  Dissemination;  name  changed 
to  Planning  Resources  Section;  72  of  93  districts  participated; 
final  report  written. 

June  1974 

Office  of  Planning  and  Dissemination  split;  Planning  Resources 
Section  changed  name  to  Educational  Products  Center  (EPC). 

November  1974 

CSSO  reelected. 

1974 

Defined  Minimum  Standards  Program  was  updated  and  adopted. 

July  1975 

State  Dissemination  Grants  Program  funded  by  USOE. 
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V    SUBSTANTIVE  RESULTS  AND  CONCLUSIONS:    A  BRIEF  ANALYSIS  OF 
THE  ROLE  OF  POLICY  IN  THE  SOUTH  CAROLINA  PILOT 
STATE  DISSEMINATION  PROGRAM  (PSDP) 


History  of  the  PSDP 

In  responding  to  the  USOE's  1970  RFP,  the  Deputy  Superintendent  and 
the  Director  of  Research  and  Planning  anchored  South  Carolina's  proposal 
to  a  well-organized,  strongly  institutionalized  and  maturing  drive  for 
innovation  and  change  in  the  state  educational  system.     As  early  as  1967, 
the  South  Carolina  State  Board  of  Education  issued  a  statement  of  educa- 
tional  philosophy,    which  formulated  the  concept  of  a  five-year  plan  for 
educational  improvement.     The  concept  enlivened  the  new  administration 
and  kept  ideas  flowing  over  the  next  three  years.     Such  ideas  led  first 
to  a  Needs  Assessment  Study  in  1968  and  then  to  11  well-developed,  specific 
and  attainable  objectives  adopted  by  the  State  Board  in  1970  (five-year 
plan.  May  8,   1970).     The  plan  sought  maximum  accountability  on  all  levels 
of  educational  operations  (initial  proposal,  1970,  p.  4).     A  computerized 
information  service  called  the  Basic  Education  Data  Services  (BEDS)  was  to 
be  developed  for  the  plan,  using  ESEA  Title  IV.     BEDS  essentially  was  a 
strong  administration  commitment  to  acquiring  the  fundamental  information 
necessary  for  effective  administrative  decision  making  and  sound,  innova- 
tive educational  programs. 

By  the  end  of  May  1970  when  the  state's  PSDP  proposal  went  to  USOE, 
the  CSSO  had  established  five  years  of  rapport  with  state  legislators, 
the  executive  branch  of  government,  his  staff,  and  local  district  super- 
intendents.   Functional  goals  were  solidly  embodied  in  the  five-year  plan 

See  **South  Carolina's  Five  Year  Plan  for  Continuous  Upgrading  of  Educa- 
tion," published  and  updated  every  year  since  1970. 
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that  had  been  accepted  and  approved  earlier  that  month  by  the  State  Board 
of  Education.     Expectations  were  high  within  the  SEA  for  its  successful 
implementation. 

The  RFP  outlining  the  PSDP  arrived  amid  these  changes,  but  was  not 
unanticipated.     The  Director  of  Planning  and  Research,  knowing  of  the 
plans  in  preparation  at  USOE  and  realizing  the  potential  value  of  the 
program  to  existing  state  plans,   prepared  its  way. 

Not  long  after  July  1970,  the  Chief  Supervisor,   a  teacher  holding  a 
doctorate  degree,  settled  into  her  new  job;  the  two  pilot  districts 
appointed  their  respective  agents,   and  the  retrieval  personnel  established 
the  new  Research  Information  Unit  (RIU).     The  Director  of  Planning  and 
Research  maintained  authority  over  the  program  throughout  the  three-year 
period  but  most  particularly  during  the  first  few  months  while  the  Chief 
Supervisor  worked  into  her  new  position.     As  the  program  matured,  the 
Director's  principal  function  was  to  integrate  the  program  into  the  normal 
administrative  and  political  activities  of  the  state  educational  system. 
He  backed  away  from  full-time  participation  in  the  program,   leaving  the 
Chief  Supervisor  with  daily  decision  making.     The. latter  maintained 
momentum,  enthusiasm,   and  the  needed  daily  management. 

A  break  came  in  January  1971,  when  the  number  of  requests  received 
that  month  was  equal  to  that  received  the  previous  July  through  December 
(Ashworth  et  al.,  1972,   p.  28).    However,  the  limited  number  of  retrieval 
personnel  and  the  inefficiency  of  the  Query  computer  search  technique 
limited  the  responses  to  about  80  per  month.     Additional  personnel  and 
alterations  in  Query  had,  by  June  1971,  cut  total  processing  time  by  half 
(continuation  proposal,   1971,  p.  21;  Ashworth  et  al.y  1972,  pi  31). 

Good  comraunications  maintained  the  stability  of  the  program.  Quar- 
terly progress  reports,  monthi^y  staff  meetings,  and  feedback  from  the 
field  agents  kept  problems  few  and  fostered  feelings  of  participation  and 
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the  importance  of  one's  position  within  the  entire  enterprise.  Formative 
evaluation  was  we  11- programmed  into  the  system. 

By  the  end  of  the  first  18  months^  the  PSDP  was  well-entrenched  in 
daily  educational  operations^  both  within  the  SEA  and  within  the  two 
pilot  districts.     The  superintendents  had  accepted  the  field  agents  as 
raembers  of  their  staffs.     The  agents  themselves  had  established  a  per- 
sonalized approach  and  were  accepted  by  both  the  local  school  administra- 
tors and  the  teachers. 

The  continuation  proposal  of  November  1971  spoke  well  of  the  linkage 
agent  concept  as  an  effective  mechanism  for  expanding  beyond  the  target 
districts.     For  example^   plans  were  made  to  extend  RIU's  services  to 
teacher  training  institutions^  to  acquaint  future  educational  practi- 
tioners with  the  dissemination  process  (continuation  proposal^   1971^  p. 
25).     Of  most  importance^  however^  were  plans  to  integrate  and  formalize 
the  dissemination  process* within  the  normal^   routine  activities  of  all 
the  local  districts.    Beginning  in  January  1972^  each  target  district 
would  designate  an  individual  to  replace  the  PSDP  communication  specialist. 
The  specialist  would  transfer  his  activities  from  his  original  pilot  dis- 
trict to  a  larger  section! of  the  state  that  included  a  number  of  new, 
interested  districts  (continuation  proposal,   1971^  p.  32).     By  June  1972^ 
both  the  pilot  and  the  nonpilot  districts  would  receive  the  same  level  of 
attention  in  training  and  assistance  from  these  new  area  specialists.  The 
intent  was  to  build  capacity  and  extend  the  dissemination  process  to 
others.     In  the  long* run,   the  area  communication  specialist  would  dis- 
appear entirely  as  a  middleman  of  no  consequence^  the  result  of  a  fully 
functioning  direct  communication  link  between  the  RIU  and  the  district  * 
representatives. 

The  program  continued  as  these  plans  indicated.     In  June  the  Chief 
Supervisor  advanced  to  become  Director  of  Planning  the  SEA,  and  one  of 
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the  original  two  agents,  an  area  communication  specialist,  took  her  place. 
The  progress  reports  announced  443  requests  received  from  the  nonpilot 
districts  through  March  31,  a  total  of  1560  overall.     Sixty-three  dis- 
tricts had  designated  their  representatives,   and  a  meeting  to  strengthen 
the  network  was  held  on  March  1,   1972  (''Quarterly  Progress  Report,"  March 

1972,  p.  2). 

A  year  later,   70  of  the  94  school  districts  used  district  repre- 
sentatives routinely,  and  5  others  had  full-  or  part-time  field  agents. 
Five  additional  district  representatives  had  been  designated  to  serve  the 
School  for  the  Deaf  and  Blind,  Youth  Services,  Departmen.t  of  Mental  Re- 
tardation, and  similar  organizations  ("Quarterly  Progress  Report,"  March 

1973,  p.  1).     By  March  31,   1973,  2833  requests  had  been  received  or  were 
in  process;  in  the  preceding  quarter,   364  requests  produced  247  microfiche 
and  125  journal  articles. 

With  little  doubt,  the  program  had  found  a  permanent  position  within 
the  state  educational  system  when  the  federal  portion  of  the  PSDP  was  dis- 
continued in  July  1973.     The  Research  Information  Unit  changed  its  name 
and  transferred  into  the  Office  of  Planning  and  Dissemination. 

The  new  Planning  Resources  Unit,   as  it  was  called,  continued  expan- 
sion to  activities  other  than  R&D  dissemination.    Emphasis  was  placed  on 
usable  products,   such  as  the  official  South  Carolina  School  Directory, 
1974-75  and  the  Survey  of ^School  Statistics,  which  would^provide  addi- 
tional incentive  for  the  LEAs  to  use  the  unit's  resources. 

An  idea  growing  that  year  realized  the  opportunities  in  information 
retrieval  that  were  abroad  in  other  government  agencies.     The  central  dis- 
semination of  information  still  remained  a  vital  concern  and  was  still 
viewed  as  the  best  use  of  limited  resources.     However,  agencies  existed 
throughout  the  state  government,  within  and  without  the  educational  sys- 
tem, that  could  provide  an  extensive  idea  base  and  a  plethora  of  services 

IX- 3 8  ' 


to  LEAs  if  only  a  central  group  would  advertise  and  promote  these  ideas 
and  services  from  a  central  location.     The  group^  which  became  the  present 
Educational  Products  Center  (EPC)  in  July  1974^  continued  the  old  linkage 
role^   but  formed  an  infomation  resources  pool  and  generated  new^  usable 
products  derived  from  the  knowledge  flow  and  utilization  of  which  the 
staff  had  so  long  been  a  part.     Requesters  were  directed  to  existing 
agencies  that  already  were  the  sources  of  certain  materials  ("State 
Dissemination  Grants  Program^"  1975^   p.   18).     The  EPC^  in  essence^  in- 
tendedj  to  refine  the  boundary  definitions  between  agencies  so  that  it 
would  not  overlap  responsibilities  but^  rather^  would  promote  cooperation 
and  accountability  in  the  development  and  dissemination  of  services  to 
the  LEAs.     The  goal  was  a  potent  fom  of  incentive  and  catalysis;  that  is^ 
let  the  agencies  produce  the  products  they  wish^  but  let  them  work  hard 
to  prevent  boundary  encroachment  by  the  EPC  on  products  that  are  needed^ 
but  not  yet  produced^  by  the  SEA  and  LEAs. 

The  Achievement  of  PSDP  Goals 

Several  major  differences  in  orientation  toward  the  PSDP  project  be- 
tween USOE  and  South  Carolina  were  expressed  during  proposal  writing. 
For  example^  South  Carolina  wanted  full  responsibility  to  manage  the 
project^  to  ensure  that  any  changes  that  were  required  for  more  consistent 
operation  within  already  existing  state  activities — even  if  inconsistent 
with  USOE  ideas — would  rest  with  South  Carolina.    Furthermore^  in  their 
dissemination  efforts^  the  staff  wanted  to  serve  LEA,  SEA,  and  other 
government  officials  as  well  as  local  educational  practitioners.  This 
latter  intent  was  based  on  the  hope  that  such  services  to  those  with  in- 
stitutional power  would  imbed  the  linkage  concept  more  deeply  into  the 
existing  educational  governance  strticture. 
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An  even  more  important  difference  existed.     From  the  start.  South 
Carolina  placed  emphasis  on  the  development  of  a  locally  based  staff  that 
would  eventually  handle  the  work  of  the  field  agent.     There  was  intense 
sensitivity  relative  to  the  local  governance  structure  of  education, 
mostly  because  of  the  traditional  emphasis  on  decentralization  in  the 
state's  culture.     Even  though  the  continuation  proposal  (1972)  was  emphatic, 
mentioning  three  times  that  the  PSDP  intended  the  SEA  to  assume  leadership 
in  the  development  and  operation  of  an  information  service  to  assist  edu- 
cational managers  and  practitioners,   it  stressed  an  extremely  strong  local 
component.     From  the  beginning,  the  PSDP  Director  knew  that  no  activity 
in  which  the  team  engaged  trrust  ever  be  construed  to  mean  undue  SEA  stress 
on  local  educators,   if  the  program  was  to  be  accepted  in  the  state.  In 
fact,   the  agent  was  to  be  clearly  distinct  from  the  SEA,  being  chosen  from 
and  paid  by  the  district  he  served.     The  staff  encouraged  teachers  to  de- 
fine their  own  problems  and  to  seek  information  as  they  needed  it. 

The  communication  specialist-- that  is,   the  extension  agent — was  not 
a  change  agent  or,   as  Guba  called  him,  a  ''diffusion  agent'-'  (Cuba  and  Clark, 
1974).    He  provided  no  solutions  to  operating  problems,  but  acted  rather 
as  a  "catalyst"  and  "process  helper,"  in  Havelock's  terms  (Havelock,  1971; 
Ashworth  et  al.,   1972,  p.  40;  Ellis,   1973,   appendix).     The  direct  personal 
relations  between  agents  and  teachers  were  intended  only  to  clarify  defini- 
tion of  problem  needs  as  seen  by  the  teacher;  selection  from  alternative 
approaches  that  were  suggested  by  retrieved  materials  became  the  responsi- 
bility of  the  client,  not  the  agent. 

The  foregoing  does  not  suggest  that  change  and  modernization  of  edu- 
cational techniques  were  not  considered  important;  to  the  contrary,  this 
was  the  theme  of  the  five-year  plan.     On  the  surface,  perhaps,   an  emphasis 
such  as  this  seems  in  conflict  with  USOE's  original  idea,  since  USOE's 
thrust  was  toward  service  to  local  educators,  not  administration  personnel. 
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toward  a  test  of  the  agricultural  extension  agent  concept  applied  to  edu- 
cation,  and  toward  an  advocacy  role  for  change.     The  USOE  manager,  however, 
approved  these  ideas  for  two  reasons:     first,  because  the  linkage  agent 
concept  was  commonly  regarded  as  new  and  unproved-- one  that  would  initially 
need  full,  flexible  rein-- and,  second,  because  the  RFP  could  be  widely 
interpreted  to  accept  these  ideas.     The  decision  put  USOE  in  a  favorable 
light  with  state  officials  and  assured  a  cordial  working  relationship  be- 
tween the  two  groups. 

The  1970  proposal  and  a  memorandum  of  agreement  with  the  USOE  in- 
tended a  test  of  a  modified  form  of  the  extension  agent  concept  suggested 
in  the  RFP  and  a  deep  penetration  of  the  dissemination  concept  into  the 
daily  routine  of  the  educational  process,   as  noted  earlier  (initial  pro- 
posal, 1970,  p.  6). 

From  the  standpoint  of  the  PSDP  staff,  both  tasks  were  accomplished 
adequately.     The  final  report  was  packed  with  a  rather" convincing  argument 
submitting  substantial  data  to  prove  the  point.     It  particularly  emphasized 
the  program's  expansion  and  growth  into  nontarget  areas. 

The  test  of  the  extension  agent  concept  was  successful  because  of 
the  personal  touch  afforded  by  the  agent,  but  also  because  it  was  anchored 
into  an  organized,  creative  team  effort.     The  Chief  Supervisor  who  set  the 
program  on  its  feet  had  captured  the  confidence  and  respect  of  all  partici- 
pants.    She  provided  the  human  balance  to  the  Director's  authoritarian  and 
''political"  drive.     The  retrieval  specialists,  all  of  whom  had  master's 
degrees,  moved  their  task  out  of  the  clerical  mode  by  providing  well- 
edited,   packaged  responses  to  requests.     For  example,  in  Fall  1971,  they 
prepared  a  catalog  of  all  requests  that  had  been  processed  since  July 
1970,     The  instrtiment  provided  not  only  good  advertising,  but  also  cut 
down  on  repetition. 
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The  agents  were  required  to  have  master's  degrees  and  experience  in 
educational  administration  (initial  proposal^  1970^  pp.   10-11).  They 
provided  a  strong  information  link  between  LEA  superintendents  and  the 
SEA.     This  link  and  acceptance  of  agents  by  the  local  schools  maintained 
for  them  a  significant  position  within  the  local  educational  process. 

The  strengths  of  the  dissemination  team  were  complemented  by  an  in- 
sightful political  Director.     He  was  the  direct  link  to  all  higher  manage- 
ment and  was  a  source  of  information  for  the  CSSO  himself.    He  made 
politically  key  use  of  the  RIU  services  in  a  number  of  ways^  to  promote 
and  to  secure  the  dissemination  concept.    Within  the  first  18  months  of 
the  program^  more  than  239  requests  had  come  from  State  Department  of 
Education  personnel^  compared  with  232  from  the  Rock  Hill  district 
(Ashworth  et  al./  1972^  p.  17).     The  Director  prepared  a  package  on  British 
infants  schools  for  the  CSSO's  participation  at  an  English  convention; 
he  established  clear  ties  with  the  state  legislature  and  their  staff  to 
help  supply  their  information  needs;  and  he  ensured  aid  to  the  State  Board 
committees  drawing  up  the  five-year  plan.     For  advertising^  he  contacted 
both  the  Library  of  Congress  and  ERIC  Central  so  they  might  add  South 
Carolina  documents  to  their  systems.     The  Deputy  Superintendent^  though 
not  on  the  staff  payroll^  made  substantial  contributions  to  the  overall 
effort.     He  and  the  Director  were  the  keys  to  the  continuation  of  the 
dissemination  concept  in  further  SEA  plans. 

No  surprise  was  expressed  when  funding  responsibility  was  transferred 
smoothly  from  the  federal  grant  to  the  SEA  in  June  1973.     The  PSDP  program, 
minus  the  extension  agent,  had  become  woven  into  the  fabric  of  daily  ac- 
tivity.    It  was  not  that  establishing  agents  was  considered  a  useless 
endeavor.     Instead^  the  idea  had  been  used  as  a  tool  for  mobilizing  and 
training  local  educational  personnel  to  continue  the  dissemination  process 
on  a  more  solid  and  less  mobile  basis.     The  present  Educational  Products 
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Center  is  a  descendant  of  that  original  program  and  continues  its  infor- 
mation dissemination  efforts  as  it  always  has,  but  now  maintains  the  de- 
velopment and  dissemination  of  useful  educational  products  as  well. 

Recommendations  pertinent  to  information  dissemination  were  pre- 
sented  in  South  Carolina's  final  report  (Ellis,   1973,  p,  3),     They  stem 
from  an  active  struggle  with  the  concepts  of  dissemination  over  the  pre-? 
vious  three  years  and  are  worthy  of  paraphrase  here  for  any  future  work 
along  these  lines: 

•  The  information  dissemination  concept  should  be  viewed  as  a 
•^partnership,"  of  the  total  educational  community  and  must 
embody  the  spirit  of  improving  education  throughout  the  state, 

•  An  information  center  should: 

-  Provide  immediate  infomation  to  aid  school  districts  in 
needs  assessment  and  decision  making, 

-  Be  designed  to  encourage,   assist,   and  facilitate  work  of 
educators  through  designated  state  and  local  agents  to 
provide  for  systematic,  comprehensive  educational  change, 

•  The  role  of  the  educational  extension  agent  is  a  helping  one 
in  providing  alternative  approaches  in  response  to  specified 
needs.  This  is  a  more  passive  and  realistic  approach  to  the 
concept  of  change.     It  is  service- oriented. 

Conclusions 

The  most  evident  reason  for  the  successful  test  of  the  modified  form 
of  the  extension  agent  concept  was  the  emphasis  placed  on  local  control 
of  the  dissemination  process.    The  decision  was  based  on  an  awareness  of 
South  Carolina's  traditionally  unfavorable  reaction  to  pre s Buret  from  a 
central  authority,  an  insight  that  USOE  would  not  necessarily  have  had. 
The  decision  required  a  change  in  the  application  of  the  extension  agent 
concept  as  it  appeared  in  literature  of  the  day. 
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Evident  reasons  also  exist  for  the  successful  continuation  of  the 
program  beyond  closure  of  1973  federal  funding.     Principally,  the  SEA 
was  committed  to  the  belief  that  effective  decision  making  and  sound  in- 
novation in  education  should  be  grounded  on  good  information. 

The  Future  of  Information  Dissemination  in  South  Carolina 

t 

The  Educational  Products  Center  stands  firm  for  the  next  years  as  a 
respected  entity  within  the  educational  system.     The  Center  serves 
effectively  as  a  statewide  linkage  system  between  local  school  districts 
and  resources  available  through  the  Department  of  Education,   other  school 
districts,  and  other  informational  sources,     USOE  has  supported  the  con- 
tinued growth  of  this  program  with  funds  from  the  July  1975  State  Dis- 
semination Grants  Program.     The  proposal  for  this  latter  funding,  which 
appeared  in  April  1975,  outlined  in  detail  the  activities,   plan  of  work, 
and  time  schedule  for  the  next  year.     Included  in  that  paper  were  develop- 
mental phases  for  five-year  dissemination  plans  that  are  meant  eventually 
to  link  multiple  states  in  a  national  dissemination  network. 
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CRITICAL  POLICIES  AFFECTING  THE  ACCOMPLISHMENT  OF 
GOALS  IN  THE  SOUTH  CAROLINA  PSDP 

Explicit  Goals  of  PSDP 

•  To  provide  access  to  and  encourage  utilization  of  research 
information. 

•  To  disseminate  information  in  a  usable  form^   leading  to  in- 
stallation of  tested  innovations  and  programs, 

•  To  test  the  extension  agent  as  a  temporary  device  for  building 
a  framework  operated  by  local  school  districts. 

Policies  Leading  to  Achievement  of  Explicit  Goals 

•  Choice  of  staff  members  led  to  a  skilled^  dedicated  team. 

•  Notion  of  policies  as  delineating  "areas  of  freedom"  rather 
than  as  "restrictions  on  motion"  led  to  many  new  ideas. 

•  Emphasis  on  innovation  and  change  was  designed  so  that  it 
could  not  be  construed  as  undue  pressure  from  a  centralized 
authority  (namely^   the  SEA).     The  agent  was  to  provide  al- 
ternative approaches  and  allow  teachers  to  choose  from  among 
them  in  solving  their  problems. 

•  Solution  to  the  cultural  bias  away  from  centralized  authority 
meant  the  active  participation  of  the  LEA  in  the  process  of 
dissemination  to  the  point  of  requiring  a  locally  governed 
framework. 


Implicit  Goal  for  the  PSDP 

Continuation  of  funding  beyond  1973. 

Policies  Leading  to  Achievement  of  Implicit  Goal 

•     Secure  foothold  for  this  program  within  the  SEA  plans. 
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•  High  degree  of  committment  and  participation  by  higher  SEA 
officials  relative  to  dissemination. 

•  High  degree  of  commitment  by  local  districts. 

•  Choice  of  Director  experienced  in  political  matters  and  SEA/ 
USOE  activities. 

•  High  advertising  profile. 
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Annex  B 

CRITERIA  FOR  FUNDING  AS  SPECIFIED  BY  USOE'S  RFP 
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CRITERIA  FOR  FUNDING  AS  SPECIFIED  BY  USOE'S  RFP* 


Technical  Adequacy  of  the  Plan  of  Operation 

•  Evidence  of  appropriateness  to  conditions  within  the  state, 

•  Explicit  rationale  for  selecting  target  districts. 

•  Specifications  for  program  staff, 

•  Relative  importance  given  to  various  phases  and  activities. 

•  Appropriate  timing  and  sequencing  of  events. 

•  Appropriate  strategies  in  soliciting  requests  and  in  de- 
veloping local  support. 

•  Appropriate  procedures  for  measuring  information  needs  and  ob- 
taining client  feedback. 


Capability  of  SEA 


Inventory  of  staff  talents  and  other  resources. 
Current  SEA  activities  related  to  LEA  problem  solving. 
Explicit  SEA  policy  on  dissemination. 

Existing  state  legislation  or  endorsements  for  SEA  acceptance 
of  the  proposed  role. 


Commitment  of  SEA 

•     A  plan  to  incorporate  these  services  into  the  continuing 

operation  of  the  agency,  both  administratively  and  financially. 


South  Carolina  was  clearly  aided  in  its  bid  for  program  continuation  be- 
yond 1973  by  the  technical  adequacy  of  its  plan  of  operation  and  its 
awareness  of  the  local  cultural  need  for  cautious  change  without  undue 
pressure  from  a  central  authority. 
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•  Allocation  of  current  staff  and  other  resources  to  project. 

•  Position  of  the  program  Director  in  the  SEA  hierarchy. 

Capabilities  of  Key  Program  Staff 

•  Education^  experience^   and  other  qualifications  of  program 
Director  (to  be  named  in  the  proposal). 

•  Competencies  and  experience  levels  of  other  personnel. 

•  Ability  to  operate  in  a  '^service"  or  assistance  capacity. 

•  Demonstrated  knowledge  of  school  problems. 

Economic  Efficiency 

•  Proposed  dollar  allocation  (cost  versus  likely  benefits). 

•  Total  cost  as  compared  with  alternative  proposals  to  provide 
equal  or  comparable  services. 
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Annex  C 


TAXONOMY  OF  POLICIES  CONSIDERED  SIGNIFICANT  IN  THE  STUDY  OF  THE 
SOUTH  CAROLINA  PILOT  STATE  DISSEMINATION  PROGRAM 
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I    EXEMPLARY  FINDINGS 


For  the  reader  who  is  interested  first  and  foremost  in  the  results 
of  this  analysis^  we  present  this  brief  discussion  of  three  principal 
findings. 

The  Key  Agents 

Finding  1:     Individual  teachers  are  the  "key*'  instructional 
material  (IM)  decision  makers  only  in  that  they  have  the  final 
say  at  the  end  of  a  long  and  complex  process.    Most  of  the 
significant  decisions  are  made  by  the  dozens  of  other  agents 
who  contribute  to  the  process. 

This  first  finding  was  discovered  in  response  to  the  question^  "Who 
are  the  key  instructional  material  decision  makers?"    Popular  and  per- 
sistent myth  indicates  classroom  teachers.     Our  analysis  shows  that  this 
myth  is  a  function  of  the  way  the  question  is  asked.     The,  question  implies 
there  ought  to  be  some  key  agent  making  a  central  decision^  but  no  one 
agent  has  much  decision-making  power  over  instructional  materials.  Simply 
because  they  make  the  final  decision  to  admit  or  veto  materials  for  the 
classroom^  teachers  appear  to  have  a  great  deal  of  control.     In  fact^  the 
ordeal  faced  by  any  new  material  is  long  and  involved^   leaving  teachers 
the  final  decision  on  only  those  materials  that  get  as  far  as  the  class- 
room.    As  a  result^   teachers  are  seldom  presented  with  more  than  a  few 
options  from  a  state-  or  district- approved  Ir&t.     These  few  options  are 
typically  homogeneous  "packages"  that  differ  more  on  characteristics  such 
as  durability  than  on  instructional  style  or  proven  effectiveness. 

Aciditional  findings  are  discussed  in  Section  V;  moreover^  Annex  B  con- 
tains many  incidental  insights  and  questions  collected  during  the  analysis. 
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Policy  Illustrating  Finding  1 

Table  X-1  shows  the  roles  of  various  agents  in  the  instructional 
materials  selection  process  in  the  most  decentralized  case  we  examined^ 
Jefferson  County  District  in  Colorado.     For  similar  policy  evidence  of 
the  limited  role  of  teachers  in  the  other  two  states  examined^  see  Sec- 
tion III. 

Implications  of  Finding  1  for  KPU    Policy  Planning 

The  principal  implication  of  this  finding  for  KPU  policy  planning^ 
in  areas  such  as  dissemination^   is  that  it  may  be  misleading  to  search 
for  the  "key  agents"  or  the  "key  policies."    Often^   the  whole  network  or 
the  coordinated  configuration  of  agents  is  the  significant  determining 
factor. 

For  instructional  materials  selection  and  evaluation^  determining 
how  the  task  has  been  divided  and  coordinated  overall  is  more  important 
than  identifying  the  key  agent.     This  brings  us  to  the  second  finding. 

The  Complexity  of  the  Process 

Finding  2:    The  instructional  material  selection  process  is  in- 
credibly complex;  however^   evidence  exists  that  the  process  is 
still  not  complex  enough  to  cope  with  the  tremendous  variety 
of  educational  needs  in  the  student  population. 

The  complex  instructional  materials  selection  and  evaluation  process 
can  be  organized  around,  a  few  key  ideas^   as  the  body  of  this  case  study 
shows.     Therefore^   it  is  possible  to  develop  a  strategy  for  analyzing  and 
mapping  the  network  without  losing  the  pattern  of  decision  making  or 
arbitrarily  oversimplifying  what  is  necessarily  complex  in  reality.  This 
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strategy  may  make  it  possible  to  respond  to  the  need  for  even  more  variety 
and  complexity  in  the  decision  process. 

That  the  existing  instructional  materials  decision  system  is  still 
not  complex  enough  is  revealed  by  the  contrast  between  policies  that  de- 
mand more  diversity  and  policies  that  outlaw  it.     The  system  is  being 
asked  to    individualize"  the  instructional  package  and  program  of  each 
student,  but,  as-  classroom  teachers  will  testify,  one  can  rarely  control 
that  much  complexity.    Moreover,  "individualization"  is  taking  on  a  new 
dimension,   the  proliferation  of  life- styles  and  subcultural  preferences. 
It  is  one  thing  to  give  every  student  an  individualized  opportunity  to 
reach  the  same  goal;  it  is  quite  another  to  offer  widely  differing  alter- 
natives and  conflicting  goals  within  the  same  educational  network. 

Policy  Illustrating  Finding  2 

To  illustrate  Finding  2,  Table  X-2  presents  several  policy  statements 
from  each  of  the  three  case-study  states.     The  table  contrasts  policy  de- 
manding more  complexity  or  variety  in  meeting  student  needs  with  policy 
demanding  uniformity  or  limiting  the  variety  of  responses  to  student  needs 

Implications  of  Finding  2  for  KPU  Policy  Planning 

The  principal  structural  implication  of  this  finding  for  monitoring 
KPU  is  that,  though  complex,   the  instructional  materials  selection  and 
evaluation  process  can  be  conceptually  organized  and  mapped.     This  mapping 
need  not  arbitrarily  oversimplify  the  process,  nor  assume  it  is  singular, 
consistent^  and  well-ordered. 

The  principal  substantive  implication  for  monitoring  KPU  is  that  one 
must  face  the  needed  complexity  squarely,   if  one  is  to  develop  a  KPU 
governance  system  that  allows  and  encourages  educational  practitioners 
<to  take  advantage  even  of  the  instructional  material  options  that  already 


Table  X-2 
POLICIES  SUPPORTING  FINDING  2 


Policies  Indicating  the  Rising  Call  for  More  Variety 
in  Instructional  Materials 

Policies  Indicating  Legal  Prohibition  of  Variety  and 
Direct  Attempts  to  Limit  the  Range  of 
Instructional  Materials 

Federal 

States  may  not  prohibit  the  teaching  of  non- English 
languages  in  the  elementary  schools   (Mo  Hock  Ke  Lok 

The  principal  instruction  language  for  all  students 
shall  be  English  (Powell  v.  Board  of  Education). 

Po  V.  Stainback)  (Bartels  v.  Iowa). 

Colorado 

Section  123-21-3  encourages  teaching  non-English- 
speaking  students  in  their  native  language  while 
they  are  making  the  transition  to  English. 

Section  123-21-4.    The  1969  updateof  the  education 
code  added  to  the  history  and  civil  government  re- 
quirements provisions  for  specific  attention  to  in- 
corporation of  contributions  of  minorities  to  the 
state  and  nation. 

Section  123-21-3:    Bilingual  schools  are  to  be  used 
only  to  assist  students  while  they  acquire  English 
skills,  not  as  the  principal  instruction  language  in 
any  schools. 

Section  123-21-4:    All  schools  in  Colorado  must 
teach  the  history  and  civil  government  of  Colorado. 

Pennsylvania 

22  Pa.  Ed.  Code  5.2  mandates  that  "The  Board  [of 
Education]   through  the  Department^   shall  delegate  to 
a  Board  of  School  Directors  the  greatest  possible 
flexibility  in  curriculum  planning  which  is  con- 
sis  ten  with  quality  education  for  every  pupil  in 
this  commonwealth." 

22  Pa.  Ed.  Code  5.24:     Provides  for  bilingual 
education. 

22  Pa.  Ed.  Code  5.3  notes  that  "The  Department  may 
grant  exceptions  to  specific  regulations  when  it  is 
necessary  to  adapt  to  particular  school  district 
curriculum  needs." 

Pennsylvania  state  court  ruled  that  state  statutes 
specifically  presenting  that  certain  subjects  be 
taught  are  mandatory  on  schools  boards  (Ehret  v. 
School  District  of  Borough  of  Kulpmont). 

22  Pa.  Ed.  Code  5.24:     Provisions  for  bilingual  edu- 
cation were  passed  in  1974.    However,   such  education 
is  reserved  for  students  making  a  transition  from 
another  language  to  English, 

Florida 

Florida  Ed.  Code  233.07:     Originally  this  section 
provided  for  the  establishment  and  operation  of  a 
state  Textbook  Conunittee.     This  has  now  been  ex- 
panded to  be  a  state  Instructional  Materials 
Committee. 

Florida  Ed.  Code  233.10:     The  findings  of  the 
Councils,   including  the  evaluation  of  instructional 
materials^   shall  be  in  sessions  open  to  the  public. 
All  decisions  leading  to  determinations  of  the 
Councils  shall  be  by  roll  call  vote,   and  at  no 
time  will  a  secret  ballot  be  permitted. 

Florida  Ed.  Code  233.34:     Up  to  25%  of  state- 
allocated  instructional  materials  funds  may  be  used 
to  purchase  materials  not  included  in  the  state- 
approved  catalogue  of  instructional  materials. 

Florida  Ed.  Code  233.07:    Materials  suitable  for 
public  school  curricula  are  chosen  by  state-levej. 
Instructional  Materials  Councils;  their  decisions 
are  transmitted  to  the  schools  in  a  state- approved 
instructional  materials  catalogue.     The  schools  must 
spend  the  bulk  of  their  instructional  materials 
funds  for  items  from  this  list. 

■5 

Florida  Ed.  Code  233.34:    The  state  determines  by 
formula  and  supplies  the  funds  for  instructional 
materials  to  the  district. 

Florida  3tate  Constitution,  Article  IX,  Section  1: 
"Adequate  provision  shall  be  made  by  law  for  a  uni- 
form system  of  free  public  schools  ...." 

Purchase  of  materials  not  on  the  state-approved  list 
must  be  conducted  within  state  standards  and  pro- 
cedural guidelines. 

exist.     If  any  single  limitation  most  inhibits  the  adoption  and  applica- 
tion of  a  wider  range  of  materials  options,   it  is  the  structure  of  the 
instructional  materials  selection  decision  itself.     This  is  the  subject 
of  the  third  finding. 

Pplicies  as  Sources  of  Information 

— ••  '  

Finding  3:    The  collected  policies  that  affect  instructional 
materials  selection  reveal  that  certain  characteristics  of 
materials  dominate  attention  in  the  decision  as  it  is  prac- 
ticed. 

A  summary  review  of  the  policies  collected  for  this  paper  reveals 
that  instructional  materials  decisions,   as  formally  practiced,   are  domi- 
nated by  the  following  characteristics: 

•  The  decision  should  be  made  rationally,  with  convergent 
^'compromise"  the  preferred  solution  for  all  types  of  con- 
flict. 

•  The  decision  is  essentially  made  up  of  technical  matters 
of  "how  to  teach." 

What  is  disturbing  about  this  finding  is  that  the  policies  fail  to 
incorporate  some  other  characteristics;  for  example: 

•  No  policies  were  found  that  make  challenging  what  should 
be  taught  as  important  as  challenging  how  it  should  be 
taught. 

•  No  policies  were  found  recognizing  that  what  should  be 
taught  and  how  it  should  be  taught  are  both  as  much  value 
issues  as  technical  issues. 

•  No  policies  were  found  declaring  that  creating  and  svis- 
taining  drastically  different  forms  of  education  at  public 
expense  in  response  to  real  value  conflicts  should  be  a 
solution  just  as  acceptable  as  homogeneous  compromise. 
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Policy  Illustrating  Finding  3 

Finding  3  pertains  to  the  overall  pattern  one  sees  when  looking  at 
instructional  materials  policy  as  a  whole;  there  are  not  a  few  key  poli- 
cies that  alone  support  or  refute  the  finding.     Therefore^  we  ask  the 
reader  to  use  the  whole  of  this  case  study  as  evidence  for  this  finding. 

Implications  of  Finding  3  for  KPU  Policy  Planning 

With  respect  to  the  process  of  instructional  materials  selection  and 
evaluation,  KPU  leaders  need  to  do  more  than  develop  a  strategy  for 
broadening  the  range  of  available  materials.     They  must  improve  the 
decision-making  process  itself  and  broaden  the  range  of  values  and  cri- 
teria employed  in  conducting  such  decision  reform  activities. 

A  final  observation  relative  to  the  foregoing  three  findings  is  that 
the  structure  of  participation  in  the  decision- making  process  is  probably 
the  most  important  determinant  of  which  materials  are  adopted — "the  medium 
as  the  message.'*    A  decision  system  organized  to  seek  compromise  solutions 
does  not  encourage  real  variety  in  developmefnt  or  adoption  of  instruc- 
tional materials.    Moreover,   a  decision  system  with  an  a  priori  preference 
for  simple  solutions  that  remain  nonpolitical  is  unable  to  generate  the 
complex  responses  demanded  by  real  value  conflicts. 


II  INTRODUCTION 


This  paper^   as  part  of  a  larger  study  of  the  KPU  governance  system^ 
focuses  on  the  set  of  formal  policies  that  affect  instructional  materials 
selection  and  evaluation. 

The  selection  and  evaluation  of  instructional  materials  became  par- 
ticularly important  to  the  federal  government  when^  during  the  Sputnik 
era^   several  federal  agencies  were  looking  for  a  strategy  to  prom.ote 
curriculum  reform.     They  chose  to  sponsor  development  and  dissemination 
of  new  instructional  materials  (see  Case  Study  VI)  as, a  result  of  three 
observations: 

•  New  curricular  ideas  and  teaching  methods  were  believed 
easily  incorporated  into  instructional  materials. 

•  Instructional  materials  appeared  easy  to  disseminate  and  to 
have  fairly  rapid  turnover  in  schools. 

•  New  instructional  materials  were  already  a  traditionally 
accepted  method  of  communication  from  knowledge  producers 
to  knowledge  users. 

Thus^  under  this  strategy  for  promoting  curriculum  change,  the 
governance  system  that  controls  the 'selection  and  evaluation  of  instruc- 
tional material  also  controls  a  major  link  between  knowledge  producers 
and  knowledge  users.     Such  a  governance  system  is  important  in  the  total 
KPU  governance  network  and  deserves  to  be  explicated. 

This  analysis  had  three  goals.     The  first  and  foremost  was  to  show 
that  a  policy-centered  analysis  can  be  conducted  on  this  topic  according 
to  the  principles  of  the  Analytic  Framework  for  Educational  Policy  Analy- 
sis.    The  second  was  to  pull  together  a  set  of  meaningful  insights  about 
how  responsibility  for  instructional  materials  selection  and  evaluation 


processes  is  divided  and  coordinated  by  various  policies.     The  third 

was  to  show  the  general  utility  of  an  analysis  of  instructional  materials 

governance. 

The  Analytic  Approach;      Using  Formal  Policy  to  Explore  Structure  and 
Process 

The  approach  taken  to  reach  the  goals  mentioned  above  had  three 

basic  steps.     The  first  step  was  using  formal  policy^  beginning  with  the 

U.S.  Constitution^   to  sort  out  the  legal  responsibility  at  the  different 

governance  levels  for  various  instructional  materials  selection  and 

evaluation  decisions.     To  do  this^  we  looked  at  federal  law  and  at  the 

state  and  local  education  policy  in  three  states:    Colorado^  Florida^  and 

t 

Pennsylvania  (see  Section  III). 

The  second  step  in  the  approach  was  examining  several  levels  of  de- 
cision making.    While  focusing  on  the  actors  who  make  the  main- line  in- 
structional materials  selection  and  evaluation  decisions^  we  elaborated 
the  configurations  of  actors  and  policies  that  provide  the  field  of  con- 
straints and  incentives  in  which  they  must  operate^   such  as  from  pub- 
lishers and  testing  agencies  (see  Section  IV). 

The  third  step  of  the  analysis  was  assessing  the  implication  of  this 
policy  structure  for  developing  alternative  strategies  to  constructively 
monitor  dissemination  of  new  instructional  materials  (see  Section  V).  ^ 


The  methodology  used  in  this  approach  (the  Analytic  Framework  for  Edu- 
cational Policy  Analysis)  is  discussed  in  detail  in  Annex  A. 

The  rationale  by  which  these  states  were  chosen  is  included  in  Annex  C. 
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Origins  of  the  Data  Used 

Two  sources  of  information  were  used  for  this  analysis.     The  primary 
source  was  archives  of  formal  policies.     Information  was  also  gathered 
by  telephone  and  personal  interviews  with  agents  engaged  in  instructional 
material  management  within  the  three  selected  states. 

The  Role  of  Policy  in  the  Division  of  Responsibility 

Responsibility  for  instructional  materials  selection  and  evaluation 
is  divided  three  ways  as  a  result  of  complex  historical  events  that  have 
shaped  American  education  over  the  past  two  hundred  years.  Decision 
making  is  divided: 

•  Among  seven  levels  of  formal  authority. 

•  Between  lay- value  decisions  and  prof essional- technical 
decisions. 

•  Among  publishers,  assessment  agencies,  and  main- line 
educators. 

The  seven  levels  of  decision  authority  are  federal,  -state,  regional, 
local  district,   school  site,  individual  teacher,  and  parent- student. 
Each  of  these  levels  is  a  forum  that  has  legal  authority  over  various 
aspects  of  the  question,  "Which  instructional  materials  should  be  used 
in  the  learning  setting?" 

The  division  between  prof essional- technical  and  lay-value  decisions 
concerns  distinguishing  between  technical  matters  that  can  best  be  de- 
cided by  professional  educators  (such  as  whether  to  use  phonics  to  teach 
new  readers)  and  value  matters  that  belong  to  individual  students  or  the 


These  seven  categories  are  taken  from  the  set  of  location  categories  in 
the  taxonomy  of  the  analytic  framework,  based  on  empirical  evidence  that 
material-relevant  decisions  are  made  at  each  of  them. 

X-11 


public  (such  as  whether  to  teach  sex  education  in  the  public  junior  high 
schools). 

The  division  of  responsibility  among  publishers,   assessment  agencies, 
and  main- line  educators  results  from  the  way  in  which  our  nation  has 
organized  the  tasks  necessary  to  physically  produce  and  move  new  materials 
into  the  classrooms.     Publishers  generate  the  products,  assessment  agents 
provide  the  framework  for  evaluating  the  products,   and  main- line  educators 
make  the  actual  selection  and  installation  of  materials  from  the  options 
available  on  the  market. 

Because  the  division  of  responsibility  along  these  three  dimensions 
differs  widely  among  the  50  states,  and  because  the  central  purpose  of 
this  document  is  to  demonstrate  the  analytic  framework,  the  discussion 
has  been  arbitrarily  limited  in  scope.     We  will  look  at  exemplary  policy 
for  instructional  materials  at  the  federal,   state,  and  local  district 
levels  in  three  states. 
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Ill    THE  FUNDAMENTAL  WAYS  THAT  POLICIES  STRUCTURE  MAIN- LINE 
INSTRUCTIONAL  MATERIALS  SELECTION  AND  EVALUATION 

Two  general  policies^  which  reflect  our  national  political  culture^ 
underlie  the  whole  body  of  law  affecting  instructional  materials.  The 
first  is  formally  stated  in  the  Constitution  in  the  ninth  and  tenth  * 
amendments- -that  the  po\>rer  to  make  (education)  decisions  belongs  to  the 
people  or  designated  lower  levels  of  government  unless  deliberately 
delegated  to  and  acted  upon  by  a  higher  level  of  government  (Montana 
State  V.  Millsap).     This  delegation  of  authority  from  the  people  to  a 
higher  governance  level  may  legally  be  accomplished  only  by  a  statute  or 
other  formally  authorized  policy.     Thus^  for  the  first  hundred  years  of 
our  national  history^  in  the  absence  of  such  statutes^   selection  of  in- 
structional materials  for  use  in  the  schools  was  under  the  control  of 
teachers^  monitored  by  school- site  boards  of  parents. 

The  second  fundamental  policy  regulating  the  instructional  materials 
selection  and  evaluation  process  is  not  easily  captured  in  a  single  for- 
mal policy  reference^  but  relates  to  our  national  preference  for  private 

* 

enterprise  and  private-sector  associations  over  public  agencies.  With 
the  rise  of  the  public  Schools  during  this  century^  the  actual  selection 
and  evaluation  of  specific  materials  has  slowly  come  into  the  hands  of 
public  officials.     However^  both  the  marketing  of  materials  and  the  en- 
forcement of  appropriate  assessment  standards  have  traditionally  been 


This  spirit  pervaded  the  Marshall  court  in  the  late  1800s  and  the  Warren 
court  as  it  swung  back  from  "Dred  Scott"  in  the  interpretation  of  the 
role  of  government  in  American  affairs  (see  Goldberg,  1971;  a  bibliography 
of  cited  and  uncited  references  is  appended  to  this  case  study). 
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left  to  private  industries  and  nongovernmental  agencies  (publishers^ 
foundations^  voluntary  associations,  accrediting  agencies,  and  testing 
services). 

In  this  section,  we  deal  with  the  first  of  these  two  policies  and 
with  the  way  in  which  specific  instructional  materials  selection  and 
evaluation  responsibility  is  actually  captured  in  the  various  policies 
and  the  organization  structure  of  our  educational,  system.     The  explica- 
tion of  the  second  policy  and  the  influence  pu  formal  policy  of  marketing 
and  assessment  agents  are  discussed  in  Section  IV. 

To  understand  how  responsibility  for  instructional  materials  selec- 
tion and  evaluation  is  formally  allocated,  we  need  to  identify  two  types 
of  policies. 

First,  we  must  identify  the  types  of  policies  that  determine 
the  decision  domains  held  by  various  materials  selection  agents 
at  each  level  of  educational  governance. 

To  identify  these  domains  we  have  to  collect  the  authorizing  policies 
that  create  and  control  the  roles  of  the  agents  and  governance  levels  in 
which  ^we  aX3  interested.     For  example,  to  understand  the  federal  domain 
for  instructional  materials  selection  and  evaluation,  ^we  must  look  at  the 
constitutional  separation  of  powers  and  at  its  interpretation  by  both 
the  Supreme  Court  and  the  Congress.     To  understand  the  options  of  a  State 
Education  Agency  (SEA),  we  must  look  at  the  state  constitution,  state 
legislative  statutes,  state- level  case  law,   and  several  other  forms  of 
relevant  policy,   particularly  that  coming  from  the  federal  level.  Ex- 
amination of  such  policies  shows  that  authorization  is  typically  of  three 
types: 

•  It  specifies  the  jurisdiction  of  a  given  agent. 

•  It  provides  guidelines  for  exercise  of  discretion  within 
that  jurisdiction  with  regard  either  to  due  process  or 
substance. 
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•  It  provides  the  basis  for  cooperation  among  agents  and 
agencies. 

These  types  of  policies  will  be  displayed  as  incoming  to  the  governance 
level  under  investigation  (see  Figure  X-1^  Box  D). 

Second^  we  must  identify  the  policies  that  emanate  from  the 
agents  in  question  as  they  exercise  their  decision  options. 

Within  each  policy-defined  framework^  each  level  of  authority  has  four 
basic  options  with  regard  to  the  policies  it  issues.       It  can: 

•  Simply  make  the  specific  instructional  materials  selection 
and  evaluation  decision, 

•  Assign  specific  decisions  to  its  professional  staff  or 
executive  agency  (with  or  without  guidelines  for  making 
the  decisions), 

•  Assign  the  decision  to  a  specific  lower  level  agency  (with 
or  without  guidelines^  perhaps  even  creating  a  new  level  of 
governance) . 

•  Through  deliberate  decision  or  benign  neglect^   simply  re- 
main silent  and  let  the  matter  automatically  revert  to  a 
lower  level  for  determination. 

These  types  of  policies  will  be  displayed  as  emanating  from  the  level  of 
governance  under  investigation  (see  Figure  X-1^  Box  E), 

Policy  Authorizing  the  Federal  Role 

The  federal  role  in  instructional  materials  selection  and  evaluation 
is  formally  specified  by  a  small  set  of  policies  springing  from  the 
Constitution,     Article  IV  and  the  ninth  and  tenth  amendments  provide  the 
people  and  the  states  with  responsibility  for  tasks  not  deliberately  and 


In  Section  IV^  we  discuss  the  strategy  for  mapping  other  indirect,  yet 
formal  policy  options  by  which  agents  at  each  level  are  able  to  exert 
pressure  on,  usurp,   or  simply  bypass  the  actions  of  others, 
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/        (Level,  for  example,  may  be  Federal,  State, 
/         Regional,  Local  District,  School  Site,  Teachers, 
or  Parents  and  Students) 
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\ 

Focus  of  Analysis 

f  

(& 

)  LOWER  LEVELS  OF  GOVERNANCE  IMPACTED  BY 
LEVEL  BEING  ANALYZED 

This  figure  is  the  general  model  for  all  other  figures  presented  in  this  case  study.  The  focus  of  analysis 
{Box  B),  in  each  figure,  is  a  level  of  education  governance.  The  objective  is  to  display  the  relevant  agents 
acting  at  this  level  and  the  paths  of  policies  that  are  either  issued  by  them  or  that  they  use  to  guide  their 
activities.  Additional  agents  in  the  graphics  are  of  two  sorts.  First  are  those  agents  from  higher  formal 
authority  levels  (Box  A)  who  issue  or  enforce  regulations  placed  on  the  level  in  question.  Second  are 
those  agents  (Box  C)  who  fall  within  the  jurisdiction  of  the  decisions  and  policies  issued  by  the  level  in 
question. 

Policies  are  captured  in  the  graphics  by  arrows  and  are  listed  in  a  table  of  policies  associated  with  each 
figure.  The  tables  for  federal  and  state  instructional  materials  selection  and  evaluation  policies  are  divided 
into  two  segments  according  to  whether  the  policy  is  incoming  or  outgoing  at  the  level  in  question.  For 
example,  below  is  the  general  table  for  listing  the  policies  that  mark  the  agent/policy  configurations  that 
give  rise  to  the  instructional  materials  selection  and  evaluation  process: 


@ 

TYPES  OF  POLICIES  FLOWING  FROM  A  TO  B 

1.  Specify  jurisdiction  of  an  agent. 

2.  Provide  guidelines  for  due  process. 

3.  Form  a  framework  for  cooperation  among 
agents. 


TYPES  OF  POLICIES  EMANATING  FROM  B 

1.  Materials  decisions  to  be  followed  (i.e.,  deci- 
sions made  by  the  agent  issuing  the  policy). 

2.  Decisions  assigning  decision  to  professional 
staff  or  executive  agency. 

3.  Decisions  assigning  decision  to  a  formally 
established  lower  level  agency. 

4.  A  formal  stand  of  silence  taken  on  the  matter. 


FIGURE  X-1    THE  GENERAL  GRAPHIC 
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formally  delegated  to  the  federal  level  by  other  provisions  of  the 
Constitution.     Education  is  not  included  in  any  of  the  other  provisions. 
These  policies  not  only  limit  formal  federal  involvement^  but  also  estab- 
lish a  principle  that  helps  prevent  evolving  statutory  or  case  law  from 
building  federal  influence  in  the  specifics  of  the  curricula  per  se. 

However^   the  Constitution  does  establish  a  system  of  priorities  that 
permits  and  requires  federal  involvement  in  the  instructional  materials 
selection  and  evaluation  processes  where  other  constitutionally  guaranteed 
rights  are  entailed.     Through  this  indirect  route^   federal  involvement 
in  education  has  grown.     For  example^   the  provision  of  the  Constitution 
making  it  mandatory  for  the  federal  government  to  provide  for  national 
defense  and  promote  the  common  welfare  is  the  basis  on  which  the  Congress 
authorized  establishment  of  what  is  now  HEW  and^   specifically^  USOE  and 
NIE  within  it.     Moreover^   these  provisions  were  the  basis  for  the  passage 
(after  Sputnik)  of  specific  education  programs^   such  as  NDEA  in  1958. 
Thus^  while  lacking  a  general  mandate  to  establish  and  operate  a  system 
of  public  instruction  (which  most  other  national  governments  have) ^  our 
federal  government  has  nevertheless  entered  this  arena  on  an  issue-by- 
issue  basis.     Slowly  but  steadily  the  Supreme  Court  has  found  that  the 
Constitution  provides  a  significant  decision  role  at  the  federal  level 

for  each  branch  of  government  in  the  conduct  of  education  and  'specifically 

t 

in  the  instructional  materials  selection  and  evaluation  process. 


This  act  was  the  first  significant  attempt  by  the  federal  government  to 
directly  influence  curricula.  However^  a  few  years  earlier  NSF  had  be- 
gun to  mount  its  "new  math"  and  "new  science"  curriculum  projects;  this 
effort  is  discussed  in  Case  Study  VI. 

Even  the  Constitution  is  subject  to  changes  that  may  affect  instructional 
materials  selection  and  evaluation.     Under  the  14th  amendment,  the  treat- 
ment of  minorities  in  textbooks  has  been  successfully  challenged;  if  the 
Equal  Rights  Amendment  is  passed^  we  can  expect  textbooks  to  change  even 
more  in  their  treatment  of  women. 
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Figure  X-2  (page  X-20)  shows  the  Supreme  Court  and  the  Congress  as 
examples  of  federal-level  agents  with  policy  roles  affecting  instruc- 
tional  materials  selection  and  evaluation.      Significant  authorizing 
policies^   such  as  those  just  discussed^   are  listed  on  the  left  side  of 
Table  X-3  (page  X-21);  significant  policies  emanating  from  Congress  or 
the  Supreme  Court ^  are  listed  on  the  right. 

Policy  Emanating  from  the  Supreme  Court 

The  Supreme  Court  has  taken  upon  itself  instxructional  materials  de- 
cisions in  two  major  areas:     religion  and  foreign  language.     In  Harfst  v, 
Hoegen,   for  example^   the  Court  found  that  the  school  board  cannot  employ 
its  power  to  enforce  religious  worship  by  children  even  in  the  faith  of 
their  parents  and,  moreover,   that  public  funds  may  not  be  used  for  the 
purchase  of  materials  to  this  end  in  public  schools.       In  Bartels  v.  Iowa 
and  again  in  Mo  Hock  Ke  Lok  Po  v.  St'ainbeck,  the  Court  found  that  the 
state  could  not  prohibit  the  teaching  of  modern  foreign  language  in  the 
elementary  schools,  not  even  below  the  fourth  grade.    What  remains  un- 
clear is  whether  the  states  can  require  that  English  be  the  principal 


The  executive  branch  and  the  individual  federal  agencies  could  be  treated 
in  a  similar  way,   but  the  effort  was  not  justified  by  the  purpose  here — 
that  is,  demonstrating  the  approach  of  the  analytic  framework. 

^The  U.S.   legal  system  follows  the  principles  of  British  common  law.  As 
a  result,  the  federal  and  state  courts  emerge  not  simply  as  policy  en- 
forcement agencies  but  as  active  and  powerful  policymaking  bodies-- 
through  case  law  they  move  decisions  from  the  informal  to  'the  formal 
realm.     Nowhere  in  education  is  this  more  evident  than  in  curriculum 
regulation  (with  the  possible  exception  of  the  growing  drive  for  school 
finance  reform). 

Because  of  the  Court's  policy  on  the  strict  separation  of  education  and 
religion,  it  was  not  until  President  Kennedy  put  together  the  ESEA 
coalition  of  educators  and  included  the  private  school  interest  is  that 
all  sides  and  special  interests  would  permit  major  education  bills 
through  Congress. 
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language  for  instruction  in  all  public  school  classrooms.    Most  states 
now  have  such  a  requirement  typically  born  out  of  fhe  efforts  to  '*Ameri- 
canize"  immigrants  in  the  early  20th  century  (for  example^  Colorado  Ed. 
Code  123-21-3;  Pennsylvania  Ed.  Code  5.24). 

The  "staff"  to  which  the  Supreme  Court  "assigns"  some  of  its  decision- 
making authority  is  the  federal  court  system.     While  this  system  has  ad- 
dressed numerous  civil  rights  cases^   for  example^  we  found  no  outstanding 
instances  in  which  the  Supreme  Court  has^^acepted^  without  formally 
hearing  decisions  having  major  impact  on  main- line  instructional  materials 
selection  and  evaluation. 

Supreme  Court  decisions  affirming  or  clarifying  the  authority  of 
lower  level  agents  must  take  the  form  either  of  upholding  statutes  or  of 
providing  final  opinion  on  a  matter  of  case  law.    For  instance^   the  Court 
has  found  that^  where  the  state  statutes  specify  how  textbooks  are  to  be 
selected^   the  local  districts  must  follow  the  statute  (Vaughan  v.  John  C. 
Winston  Co. ) .     States  can  require  the  local  districts  to  buy  textbooks 
only  from  lists  on  record  with  the  Chief  State  School  Officer  (CSSO)  at 
prices  therein  named  (Macmillan  Co.  v.  Johnson).     States  can  assign  the 
textbook  selection  task  to  state  education  agency  personnel^,  such  as  the 
State  Board  of  Education  (SBE)  or  the  CSSO  (North  Dakota  State  v.  Totten). 
Moreover^   the  Court  has  effectively  upheld  the  right  of  school  districts 
to  choose  and  use  only  one  common  textbook  when  individual  parents  would 
prefer  their  children  to  use  different  materials  (Illinois  School  Trustees 
v.  People).     Effectively  then^   it  is  not  incumbent  on  the  states  or  the 
schools  to  differentiate  among  classrooms  or 'school  sites  to  offer  dif- 
ferent versions  of  the  same  lessons. 

Finally^   the  Supreme  Court  formally  affects  policy  by  two  types  of 
silence.     The  first  is  a  refusal  to  hear  a  case  at  all.     The  second  is  a 
ruling  either  that  a  case  once  heard  is  not  in  the  Court's  jiijjisdiction 
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FIGURE  X-2    FEDERAL  MAIN  LINE  INVOLVEMENT  IN  INSTRUCTIONAL  MATERIALS 
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or  that  the  point  is  moot.     The  availability  of  resources  for  education^ 
including  instructional  materials^  has  been  profoundly  affected  recently 
by  Rodriguez  v.  San  Antonio  Independent  School  District,   in  which  the 
Court  maintained  formal  silence  by  ruling  that  the  case  belonged  to  de- 
termination within  the  State  of  Texas, 

Policy  Emanating  from  the  Congress 

By  constitutional  mandate^   the  Congress  is  formally  precluded  from 
prescribing  the  content  of  the  curriculum.     However^   through  the  National 
Defense  Education  Act  of  1958  and  the  Elementary  and  Secondary  Education 
Act  (ESEA)  of  1965^   Congress  established  two  precedents.     The  first  is 
the  congressional  right  to  encourage  curriculum  change  by  offering  in- 
centives for  congressionally  favored  options.     The  second  is  to  provide 
resources  for  adoption  of  instructional  materials  even  to  private  school 
students  by  focusing  the  aid  on  the  student  rather  than  on  the  school  he 
attends. 

However^   the  Congress  has  .made  its  chief  impact  on  curriculum  through 
its  executive  staff^   such  as  USOE  and  NIE^   and  through  establishing  pro- 
grams to  be  managed  by  these  agencies.     The  NSF  SMSG  program  (see  Case 
Study  VI)  marked  the  start  of  this  effort. 

When  simple  development  of  materials  did  not  lead  to  their  immediate 
adoption^   Congress  turned  to  improving  the  responsibility  and  responsive 
capacity  of  lower  levels  of  government.     Through  ESEA  and  the  recent 
capacity-building  mandates^   Congress  directly  supplied  resources  and  a 
statement  of  basic  congressional  intent  to"  encourage  change  by  SEAs^ 
Regional  Educational  Service  Agencies  (RESAs)^   local  districts^   and  even 
individual  teachers. 

Congressional  silence  within  its  legal  domain  is  typically  the  re- 
sult of  either  a  deadlock  of  interests  or  the  newness  (low  visibility) 
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of  the  problem.     Currently^  congressional  silence  relative  to  several 
aspects  of  education  is  crucial^  but  they  are  not  in  the  main- line  in- 
structional materials  selection  and  evaluation  process.     The  problems  lie 
more  in  copyright  laws  and  in  personal  privacy  and  educational  assessment 
policies, 

A  Summary  of  Federal  Participation 

The  net  effect  of  the  constitutional  limitations  on  the  federal  role 

•k 

is  that  the  Supreme  Courts  directly^     is  the  most  significant  policy- 
determining  body  at  the  federal  level  relative  to  instructional  materials 
selection  and  evaluation.    The  Court  determines  what  materials  shall  be 
available  (Macmillan  Co.  v.  Johnson)^  who  may  exercise  choice  (Vaughan  ^ 
V.  John  C.  Nixstonce),   and  what  resources  shall  be  used  for  instructional 
materials  (Rodriguez  v.  San  Antonio  Independent  School  District).     This  . 
situation  will  probably  continue  so  long  as  Congress  is  precluded  from 
affecting  the  curriculum  by  direct  means  other  than  incentives  (unless 
those  incentives  become  a  major  fraction  of  local  education  expenditures). 

The  Role  of  State  Government 

Under  the  U.S.  Constitution  (article  IV  and  the  10th  amendment)^  the 
states  have  final  responsibility  for  public  education.  With  the  exception 
of  responsibilities  slowly  being  assumed  by  Congress  and  those  within  the 
domain  of  the  Supreme  Courts  state- level  constitutions^  legislatures^  and 
courts  have  the  final  authority  for  management  of  the  educational  system. 
How  the  individual  states  handle  this  responsibility  is  varied.     As  case 


The  Congress  and  the  President  each  have  powerful  indirect  means  at 
their  disposal^  by  which  they  affect  instructional  materials  selection 
and  evaluation. 
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studies  for  this  analysis^  we  examined  how  Colorado^  Pennsylvania^  and. 
Florida  govern  the  instructional  materials  selection  and  evaluation 
process, 

Florida:     Procedure  for  Selection  of  Instructional  Materials 

Of  the  three  states  examined  in  this  pilot  study^  Florida  retains 
the  greatest  responsibility  for  instructional  materials  selection  and 
evaluation  at  the  state  level--in  the  state  legislature^   in  the  State 
Board  of  Education^   and  in  their  professional  education  staff  (the 
Florida  State  Department  of  Education).     This  authority  is  vested  by 
the  state  constitution  (article  IX) ^  which  states  simply  that:  ''Adequate 
provision  shall  be  made  by  law  for  a  uniform  system  of, free  public 
schools  . . . . " 

In  response  to  this  charge^   the  Florida  Legislature  has  taken  full 
responsibility  for  the  schools  and  has  defined  instructional  materials 
as : 

...  items  that  by  design  serve  as  a  major  tool  for  assisting 
in  the  instruction  of  a  subject^  course^   or  activity.  These 
items  may  be  available  in  bbund^  unbound^   kit^  or  package 
form^   and  may  consist  of  hard  or  softback  textbooks^  consum- 
ables^  learning  laboratories^   slides^   films  and  filmstrips^ 
recordings^  manipulatives^   and  other  commonly  accepted  in- 
structional tools  [.Florida  Statutes  233.07  (4)]. 

While  each  district  is  responsible  for  selecting  those  instructional 
materials  most  suited  to  its  needs^  choices  must  typically  be  from  the 
state- approved  list  [233.34(2)].     Each  district  is  allotted  a  materials 
budget  according  to  a  formula  by  the  State  Department  of  Education  (236) 
and  may  spend  up  to  15%  of  this  budget  for  purchase  of  materials  other 
than  those  in  the  state  catalogue  [233.34(2)].     From  this  257o,  districts 
are  allowed  to  support  production  of  materials  designed  and  developed 
within  their  districts  [230.03(1)].    However,   all  such  purchases  must  be 
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conducted  within  state  guidelines  and  routed  through  the  regular  state 
materials  purchasing  channels  [230,03(1)],     No  large  discretionary  funds 
are  given  as  block  grants  to  the  districts  for  materials  (contrast  this 
with  Pennsylvania)^  nor  are  funds  directly  collected  by  the  local  dis- 
trict for  such  purposes  (as  in  Colorado) •     No  formal  appeal  is  specified 
in  the  state  code  for  local  districts  to  exceed  this  25%  limit  on  non- 
approved  materials. 

Therefor^^  at  least  15%  of  the  expenditure  on  instructional  materials 
is  for  materials  from  the  Florida  State-Adopted  Instructional  Materials 
Catalogue.     Because  of  this  basic  structure  for  instructional  materials 
selection  and  evaluation^  there  are  three  stages  of  activities  that  govern 
the  introduction  of  most  new  instructional  materials  into  the  classroom: 

•  The  types  of  materials  needed^  must  be  determined^   and  a 
state- level  materials  review  system  must  be  established. 

•  The  available  items  that  meet  specific  needs  must  be  iden- 
tified and  added  to  the  state  list  of  approved  materials. 

•  Materials  must  be  selected  from  the  list  and  installed  by 
the  districts.  -  " 

Each  of  these  is  discussed  below. 

Policies  Specifying  the  Process  for  Determination  of 
Instructional  Materials  Needs  and  Establishment  of  Review 
Panels 

Each  year  the  Commissioner  of  Education  submits  suggestions  of 
the  subject  areas  for  desirable  new  adoptions  to  the  State  Board  of 
Education  [ 233. 07(1) (b)] ,     This  consideration  is  based  on  information 
received  from  the  district  [ 233. 07(1) (b)]   and  on  the  expected  expiration 
of  the  regular  four-year  cycle  for  material  evaluation  (233.17).  More- 
over^ the  Commissioner  makes  recommendations  about  the  Instructional 
Materials  Councils  (also  called  review  panels)  that  will  be  necessary 
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for  reviewing  materials  [233.07(1) (b)]  and  recommends  professional  edu- 
cators and  lay  citizens  to  serve  on  these  councils  [ 233. 07 (1) (b) ] . 

From  these  recommendations  the  State  Board  determines  the 
numbers  of  Instructional  Materials  Councils  that  will  be  convened  and 
the  topics  they  will  cover^   and  appoints  their  membership  [233.07(1)]. 
Each  council  has  nine  members:     four  teachers^   two  lay  members^  one  local 
school  board  member^   and  two  supervisors  of  teachers.     In  addition^  each 
council  has  two  ex  officio  members:     the  Commissioner  of  Education  and  a 
member  from  the  State  Department  of  Education^  who  serves  as  council 
secretary  (233.07).     [The  task  of  secretary  is  crucial  because  the  law 
requires  that  detailed  records  of  proceedings  and  findings  be  kept 
(233.09(5).]     As  the  first  order  of  business^   the  council  elects  a  chair- 
man and  a  vice-chairman  [233.09(2)],     The  rules  and  guidelines  [233.09(3)] 
for  the  ensuing  evaluation,   the  criteria  [233.09(4)]^   and  the  uniform 
evaluation  forms  [ 233. 09 (3) (b) ]   to  be  used  by  district  evaluation  coun- 
cils,  professional  associations,   and  interested  persons  in  the  general 
public  are  generated  and  transmitted  to  the  Commissioner.^  The  criteria 
and  procedures  are  written  into  a  public  statement  [233.09(04)].  The 
process  of  assessing  specific  new  materials  for  the  state- approved  list 
may  now  begin. 

Policies  Specifying  How  the  State-Approved  List  Shall  Be 
Constructed 

After  the  councils  are  established  and  members  agree  upon  the 
criteria  and  procedures  to  be  followed,   a  call  for  bids  must  be  adver- 
tised in  Tallahassee  newspapers  before  May  15  of  each  year  (233.14)  (see 
Figure  X-3  and  Table  X-4).     Materials  are  delivered  by  the  bidder  to  the 
State  Department  of  Education  [ 233. 14(3) ] .     When  bids  have  been  submitted 
and  sample  materials  have  been  distributed  by  the  Department  to  the  coun- 
cil,  the  evaluation  process  begins.     The  council's  ultimate  product  is  a 
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FIGURE  X-3    FLORIDA  STATE-LEVEL  POLICY  ON  INSTRUCTIONAL  MATERIALS 
SELECTION  AND  EVALUATION 

list  of  materials  recoiranended  for  inclusion  in  the  Department's  state 
list  of  approved  instructional  materials  [233.09(5)]. 

All  council  meetings  must  be  public  (233.10).     Decisions  leading 
to  determinations  of  the  council  must  receive  a  roll  call  vote;  secret 
balloting  is  not  allowed  (233.10),     Together  with  the  recommendations  (a 
ranked  list  of  recommended  adoptions  for  each  grade  and  subject  area), 
the  councils  must  describe  the  procedure  used  to  generate  each  recom- 
mendation.    They  must  also  state  other  information,   opinions,  and  recom- 
mendations deemed  helpful,   including  dissenting  opinions.     All  of  the 
foregoing  must  be  assembled  in  a  package  appropriate  for  publication 
[233.09(5)]. 

^» 
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FLORIDA  STATE- LEVEL  POLICIES  AFFECTING  INSTRUCT I C»JAL  MATERIALS  SELECTION  AND  EVALUATION 


Incoming  Policy 


Article  9,  section  1,  Florida  Constitution. 


Outgoi'n'gHj'olicy 


Selection  of  instructional  materials  must  be  made  from  state- 
approved  list  [233.34(2)3. 

Districts  allotted  a  materials  budget  must  follow  formula  set 
by  SDE  (236). 

Up  to  25%  of  materials  budget  may  be  spent  on  items  not  on  the 
state-approved  list.     Items  designed  and  developed  within  the 
district  will  be  paid  for  from  this  amendment  [230.03(1)]. 

All  purchases  of  instructional  materials  shall  be  conducted 
within  state  guidelines  and  routed  through  regular  state 
materials  purchasing  channels  [230.03(1)]. 

No  appeal  of  the  257.  ceiling  on  purchase  of  instructional 
materials  not  on  state- approved  list  is  provided,  by  the  state 
code.  i 

Commissioner  recommends  annually  the  areas  in  which  instruc- 
tional materials  shall  be  submitted  for  adoption. 

Tlie  above  consideration  is  to  be  based  on  information  from  the 
districts  [ 233. 07 (1) (b) ] . 

All  selections  of  instructional  materials  expire  after  four 
years  of  use  (233.17). 

The  Commissioner  shall  recommend  the  instructional  materials 
panels  (councils)  to  be  convened  and  the  names  of  prospective 
panel  members. 

The  State  Board  shall  use  these  recommendations  to  determine 
what  panels  shall  meet  and  their  membership. 

Each  panel  is  to  have  nine  members  (four  teachers,   two  lay 
members,  one  LBE  member,   and  two  supervisors  of  teachers)  and 
two  ex  officio  members  (the  Commissioner  of  Education  and  a 
member  of  SDE  who  serves  as  secretary)  (233.07). 

Detailed  records  of  the  panel  proceedings  and  findings  shall 
be  kept  [233.09(5)]. 

As  the  first  order  of  business,  panels  shall  meet  to  select 
chairmen  and  vice-chairmen  and  develop  the  rules  and  forms  to 
be  used  on  the  evaluation  (233.09).  , 

The  information  concerning  the  panel  in  compliance  to  233.09 
shall  be  written  as  a  public  document  (233.14). 

After  a  panel  is  established,  it  must  place  a  call  for  bids 
in  the  Tallahassee  newspapers.    This  must  happen  before  May  15 
of  each  year. 

The  panel  is  to  produce  recommendations  regarding  materials 
for  the  SDE  to  place  on  the  state- approved  list  of  instruc- 
tional materials  [233.09(5)]. 

All  panel  meetings  must  be  public,  and  all  decisions  leading 
to  a  determination  must  receive  a  roll  call  vote  (233.10). 

All  panel  materials  together  with  dissenting  opinions  shall  be 
assembled  at  the  end  of  the  study  period  in  a  package  suitable 
for  publication  [233.09(5)]. 

Panel  findings  are  delivered  to  the  Commissioner  of  Education 
to  be  presented  to  SDE. 

Selection  of  new  materials  must  be  delayed  until  affcdr  May  1 
of  each  year  [233.34(4)].  ' 

Materials  chosen  from  the  list  and  purchased  with  state  funds 
become  the  property  of  the  district  [233.47(1)]. 

Materials  must  be  determined  obsolete  or  worn  out  before  dis- 
tricts may  replace  them  (233.37). 
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when  a  selection  .council  completes  its  recommendations^  they 
are  given  to  the  Commissioner  of  Education^  who*  submits  them  to  the  SDE 
[233.09(5)]. 

The  State  Department  of  Education  has  the  authority  to  select^ 
from  the  council's  list^  the  items  to  be  entered  on  the  state  list  of 
approved  instructional  materials  that  is  submitted  to  the  SBE.     In  addi- 
tion to  council  recommendations^   the  Department  of  Education  considers 
the  bids  submitted  by  publishers  who  will  furnish  the  materials.  After 
the  SBE  has  determined  which  items  shall  receive  approval^  the  districts 
tender  their  orders  and  the  state  purchases  materials  to  fill  the  demand. 
Each  year  the  approved  materials  are  listed  in  a  catalogue  distributed 
to  each  district. 

Policy  Specifying  Selection  of  Materials  from  the  State- 
Approved  List 

S^election  of  materials  from  the  list  is  conducted  primarily 
within  local  district  agencies^  but  state  policies  generally  specify  the 
process  to  be  followed.     Selection  of  textbooks  for  a,  new  year  must  be 
conducted  after  teachers  have  been  hired  for  that  year  [233.34(4)]. 
Materials  chosen  from  the  list  and  bought  with  state  funds  become  the 
property  of  the  district  on  delivery  [233.47(1)].    Districts  may  choose 
materials  not  on  the  state- approved  list^  but  such  materials  must  be 
purchased  within  state  allotments  for  instructional  materials  and  not  in 
excess  of  257o  of  that.     Moreover^   such  purchases  must  be  made  within 
state  guidelines.    Materials  must  be  obsolete  or  physically  worn  out  be- 
fore the  state  will  allow  districts  to  replace  theiti  with  newly  adopted 
items  (233.37). 

■  ■  I 
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Pennsylvania:     Procedure  for  Selection  of  Instructional  Materials 

Of  the  three  states  examined  here^   the  state- level  policy  affecting 
the  conduct  of  the  instructional  materials  selection  and  evaluation 
process  (rather  than  the  range  of  choice  from  x<rhich  to  choose)  is  most 
detailed  in  Pennsylvania  and  entails  the  greatest  mixture  of  state  and 
local  agents  (see  Figure  X-4  and  Table  X-5).     The  Pennsylvania  Constitu- 
tion (article  III^   section  4)  charges  the  state  legislature  with  the 
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FIGURE  X-4    PENNSYLVANIA  STATE-LEVEL  INVOLVEMENT  IN  INSTRUCTIONAL 
MATERIALS  SELECTION  AND  EVALUATION 


primary  responsibility  for  education  in  the  state.     The  Pennsylvania 
Supreme  Court  has  repeatedly  interpreted  this  mandate  to  mean  that  the 
legislature  is  the  final  authority  over  school  matters.  (Jones  v.  Holes; 
Ehret  v.   School  District  of  Borough  of  Kulpmont),    Moreover,   in  Pennsylvania 
the  local  school  districts  have  no  authority  to  levy  taxes  for  the  schools 
except  as  authorized  by  the  legislature  (Wilson  v>  STehool  District  of 
Philadelphia) . 
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Table  X-5 


PENNSYLVANIA  STATE- UeVEL  POLICIES  AFFECTING  INSTRUCTIONAL  MATERIALS  SELECTION  AND  EVALUATION  PROCESS 


Incoming  Policy 

Outgoin_£  Policy 

Article  III^  section  4:    The  responsibility  for 
public  education  in  Pennsylvania  is  vested  in 
the  state  legislature. 

Jones  V.  Holes;  Ehret  v.  School  District  of  Kulpraont: 
The  state  legislature  has  final  authority  in  school 
matters. 

Wilson  V.  School  District  of  Philadelphia:    Thp  local 

school  districts  do  not  have  the  authority  to  levy  taxes 
except  as  authorized  by  the  state  legislature. 

The  local  boards  of  school  directors  are  responsible  for 
the  purchase  and  free  furnishing  of  textbooks  and 
supplies  in  the  schools  (8-801). 

The  local  district  superintendent  is  to  report  to  the 
local  district  board  of  directors  those  subjects  that 
need  new  texts  and  reconinend  which  materials  to  purchase 
(8-803). 

As  part  of  the  considerations  that  compose  the  materials 
recommendations^  the  superintendent  must  consult  with  the 
teachers  who  will  be  using  the  materials  in  the. coming 
year  (Butler  v.  Shirley  Tp  School  District). 

The  process  of  materials  evaluations  and  recommendations 
shall  be  conducted^  at  most^  twice  a  year  (8-803). 

The  local  board  of  school  directors  is  required  to  adver- 
tise and  take  bids  for  purchases  to  exceed  $1500  (8-807) • 

Supplemental  materials  selection  imist  be  made  in  the  same 
manner  as  for  textbooks,  except  that  they  are  not  under 
the  restraints  of  two  or  fewer  reviews  per  year  or  the 
necessity  to  take  bids  for  purchases  over  $1500  (8-807). 

Except  by  a  two- thirds  vote  of  the  LBE,  the  textbooks  may 
not  be  charged  without  the  recommendation  of  the  super- 
intendent (8-807). 

A  recorded  roll  call  vote  is  required  for  adoptions  of 
textbooks  or  courses  of  study  and  for  entering  into  all 
contracts  of  over  $100  (8-807). 

The  district  superintendent  must  make  an  annual  report  to 
the  state  superintendent  and  supply  additional  reports  as 
the  state  superintendent  may  require  (10-1006). 

No  district  employee  may  act  as  a  publisher's  representa- 
tive (8-808). 

Any  employee  accepting  a  bribe  or  attempting  to  influence 
a  book  purchaser  shall  be  guilty  of  a  misdemeanor 
(8-810). 

Any  publisher  attempting  to  bribe  a  district  employee 
shall  be  guilty  of  a  misdemeanor  (8-809). 
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Based  on  such  policies^   it  would  seem  that  the  state- level  agents 
might  exercise  central  control  of  the  schools.     However^   this  is  not  the 
case.     Pennsylvania  has  a  strong  ''local  control  of  schools*'  tradition  in 
its  political  culture.     Therefore^  the  legislature  has  deliberately 
delegated  most  of  the  curricular  decisions  to  the  local  district  (sections 
8-80  et  seq. ).     Moreover^  unlike  Florida^   it  has  put  direct  control  of 
funds  for  instructional  materials  selection  and  evaluation ^ in  the  hands 
of  local  district  administrations.     Basic  responsibility  for  carrying  out 
all  identification^  evaluation^  and  selection  of  instructional  materials 
and  for  negotiating  purchasing  contracts  with  publishers  is  given  to  the 
local  district  agent  (8-801). 

However^   the  state  legislature  has  laid  down  a  detailed  set  of 
statutory  guidelines  as  to  how  the  districts  shall  actually  select  and 
purchase  materials.     The  legislature  has  also  specified  a  few  basic 
criteria- that  the  materials  must  satisfy. 

The  central  agent  for  coordinating  the  instructional  materials  selec- 
tion and  evaluation  process  is  the  local  district  superintendent,  who 
must  report  to  the  local  district  board  of  directors  which  subjects  need 
new  textbooks  and  must  recommend  which  books  to  purchase  (8-803) •  To 
compile  a  list  of  needed  materials,   the  superintendent  is  required  to 
consult  with  the  teachers  after  they  have  been  selected  for  the  new  school 
year  (Butler  v,  Shirley  Tp  School  District), 

The  local  district  board  of  directors  is  responsible  for  actual  pur- 
chase of  necessary  instructional  materials  (8-803).     The  board  must  fur- 
nish textbooks  and  supplies  free  of  cost  for  use  in  their  district  (8-801), 
Textbook  review  is  to  be  conducted,   at  most,   twice  yearly  (8-803).  Where 
the  value  of  the  purchase  exceeds  $1500,  the  board  is  required  to  adver- 
tise and  take  bids  (8-807).     Although  selection  of  supplementary  books 
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must  be  conducted  in  the  same  manner  as  for  textbooks^  they  are  not  sub- 
ject to  the  twice  yearly  constraint  (8-807)^  nor  must  they  be  advertised 
for  bid. 

While  the  Pennsylvania  Legislature  has  chosen  to  put  the  control. of 
funds  directly  in  the  hands  of  local  school  directors^  it  has  also  estab- 
lished a  set  of  checks  and  balances  on  local  agents  and  requires  adequate 
public  reporting  of  all  significant  transactions  (just  as  the  Florida 
Legislature  required  of  the  Instructional  Materials  Councils), 

The  school  board  cannot  change  textbooks  without  a  recommendation 
by  the  local  superintendent^  except  by  a  two- thirds  vote  of  that  board 
(8-807).     An  affirmative  vote  of  a  majority  of  all  members  of  the  boards 
duly  recorded  and  showing  how  each  member  voted^   is  required  for  various 
items,  including  adoption  of  textbooks  and  courses  of  study,   as  well  as 
entry  into  any  contract  exceeding  $100  (8-807).     The  district  superin- 
tendent  must  make  an  annual  report  to  the  state  superintendent  and  supply 
additional  reports  and  information  as  the  CSSO  may  request  (10-1006). 

Because  the  local  districts  must  deal  directly  with  publishers  and 
negotiate  prices  at  the  local  level,   the  Pennsylvania  Legislature  has  made 
several  specifications  regarding  this  relationship.    Besides  the  mandated 
public  bidding  and  recording  of  all  contracts  (8-807),   the  legislature 
has  specified  that  no  district  empjoyfie  may  act  as  a  publisher's  repre- 
sentative (8-808).     Any  employee  seeking  or  accepting  a  bribe  to  influence 
a  book  purchase  is  guilty  of  a  misdemeanor  (8-810),   as  is  any  publisher 
who  attempts  to  provide  a  bribe  to  a  district  employee  (8-809). 

Within  these  basic  constraints,   it  is  necessary  to  look  at  the  local 
district  instructional  materials  selection  and  evaluation  policy  and  at 
the  specific  reporting  requirements  of  the  CSSO  to  see  how  specific 
materials  are  selected. 

X-33 


482 


Colorado;     Procedure  for  Selection  of  Instructional  Materials 


Colorado  schools  are  operated  under  one  of  the  strongest  norms  of 
local  control  in  the  country*     In  fact,  the  political  culture  of  Colorado 
so  favors  local  control  in  the  schools  that  the  state  constitution  itself 
guarantees  this  right  (see  Figure  X-5  and  Table  X-6),     Article  IX,  section 


State  Constitution 


State  General  Assembly 


Local  Boards  of  Education 


FIGURE  X-5    COLORADO  STATE-LEVEL  INVOLVEMENT  IN  INSTRUCTIONAL  MATERIALS 
SELECTION  AND  EVALUATION 

15,  specifies  that  it  is  "the  local  School  Boards  which,  shall  have  con- 
trol of  instruction  in  the  public  schools  of  their  respective  districts," 
So  that  this  control  may  not  be  usurped  indirectly  by  moving  control  of 
textbooks  to  the  state  level,  article  IX,  section  16,   specifies  that 
"neither  the  General  Assembly  nor  the  State  Board  of  Education  shall  have 
the  power  to  prescribe  textbooks  to  be  used  in  the  public  schoolis,"  Be- 
cause of  these  two  mandates,  there  is  little  formal  policy  relating  to 
instructional  materials  selection  and  evaluation  above  the  local  district 
level.     Interviews  with  prof essional  educators  in  Colorado  reyealed  that 
the  SEA  steadfastly  avoids  infringing  on  these  local  rijghts,  $election 
and  evaluation  of  instructional  materials  is  totally  a  lockl  responsi- 
bility. .  .•'  ■ 


Table  X-6 


COLORADO  STATE- LEVEL  POLICIES  AFFECT-ING  INSTRUCTIONAL 
MATERIALS  SELECTION  AND  EVALUATION 


Incoming  Policy 

Outgoing  Policy 

Article  IX, -  section  15:    The  LBE 
shall  have  the  control  of  public 
instruction. 

Article  IX,  section  16:  Neither 
the  general  assembly  nor  the  SBE 
shall  have  the  power  to  prescribe 
textbooks. 

The  Colorado  statutes  do  not  con- 
tain provisions  on  what  should  be 
done  concerning  curriculum  in  the 
districts,  or  how  it  should  be 
done. 

Sumro^  ry 

We  can  characterize  the  governance  of  instructional  materials  selec- 
tion and  evaluation  at  the  state  level  in  Florida,  Pennsylvania,  and 
Colorado  as  follows: 

•  Florida  approves  a  range  of  materials  from  which  the  local 
districts  may  make  selections  and  the  specific  criteria 
they  should  use  in  the  selection  of  nonapproved  materials. 
Details  of  selection  procedures  are  left  to  local  determi- 
nation. The  state  also  provides  each  district  with  finan- 
cial credit  for  materials. 

•  Pennsylvania  specifies  at  some  length  who  should  make  the 
choice  at  the  local  district  level  and  what  procedures  they 
must  follow.     They  leave  the  development  of  criteria  and 
the  review  of  materials  to  the  local  level.    The  state 
gives  each  district  an  allowance  for  instructional  materials. 

•  Colorado  designates  the  local  districts  as  fully  responsible 
for  developing  a  procedure  to  accomplish  instructional 
materials  selection  and  evaluation,  for  developing  criteria, 
for  contracting  with  publishers,  and  for  conducting  the 
selection  and  evaluation.     The  state  gives  responsibility 

to  the  local  district  for  raising  and  spending  funds  for 
instructional  materials. 

Table  X-7  summarizes  the  basic  policies  that  characterize  the  three  states. 
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The  Role  of  Local  District  Government 


Each  of  the  three  states  formally  specifies  that  the  local  school 
board  has  the  legal  responsibility  for  selecting  the  specific  instruc- 
tional materials  to  be  used  in  the  district^  or  for  authorizing  teachers 
or  administrators  to  make  instructional  materials  choices.  Therefore^ 
we  will  look  at  three  districts,  one  in  each  state,  to  complete  this 
analysis  of  policies  directly  pertaining  to  the  instructional  materials 
selection  and  evaluation  process. 

.Three  large  and  well-known  districts  were  chosen.     Their  major 
demographic  features  are  shown  in  Table  X-8. 


Table  X-8 

BASIC  DEMOGRAPHICS  OF  THREE  DISTRICTS 


Comparison  of  Districts 

Statistical 
Feature 

Jefferson  County, 
Colorado 

Dade  County, 
Florida 

Philadelphia, 
Pennsylvania 

Number  of  pupils 

70,813 

245,242 

292, 741 

Budget  (thousands 
of  dollars) 

$67,458 

$252, 708 

$450,  389 

Number  of  district 
professional  staff 

3,683 

11,  954 

17,480 

Source:     1972  Census  of  Governments,  U.S.  Bureau  of  the  Census 


At  the  state  level,  Florida  issued  the  most  prolific  instructional 
materials  selection  and  evaluation  policy  and  Colorado  issued  the  least, 
but  at  the  local  level  the  opposite  is  true.     Therefore  we  will  first 
discuss  Colorado,  then  Pennsylvania,  and  finally  Florida. 
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Jefferson  County  School  District  of  Colorado 


The  strong  tradition  of  local  control  in  education  in  Colorado  calls 
for  each  district  to  develop  its  own  policies  for  determining  who  will 
evaluate  and  select  materials  and  the  procedures  and  criteria  to  be  used. 
District  policies  in  Jefferson  County  (see  Figure  X-6  and  Table  X-9)  pro- 
vide a  Committee  of  Teachers  and  Curriculum  Developers  to  initiate  the 


Jefferson  County 
Board  of  Education 


Superintendent 


Citizen's  Advisory 
Committee 


Directors  of 
Curriculum 


Curriculum 
Council 


Committee  of  Teachers  and 
Curriculum  Developers 


Any  Staff  Member 

-OF-Citizeo-^  


FIGURE  X  e    DEVELOPMENT  OF  A  COUNTY  APPROVED  MATERIALS  LIST:  JEFFERSON 
COUNTY,  COLORADO 


ERIC 


materials  discussion  by  reviewing  available  materials  and  making  recom- 
mendations for  approval,  deletion,  or  rejection  of  entries  of  available 
materials  on  the  county- approved  materials  list  [JC  Ed.  Pol.  6340.1(1)]. 


The  recommendations  for  approval  are  then  submitted  to  a  Citizens/ 
Advisory  Committee,  which  reviews  the  recommendations  and  issues  a  report 


X-38 


0^ 


487 


Table  X-9 


POLICIES  AFFECTING  INSTRUCTIONAL  MATERIALS  SELECTION  AND 
EVALUATION:    JEFFERSON  COUNTY,  COLORADO 


Committee  of  Teachers  and  Curriculum  Developers  recommends  approval^ 
deletion,   or  rejection  of  entries  on  the  county- approved  materials 
list  [6340.1(1)1. 

Citizens'  Advisory  Committee  reviews  recommendations  for  approval  and 
submits  their  report  to  the  Directors  of  Curriculum  [6440.1(B)]. 

Directors  of  Curriculum  arrange  conference  between  Advisory  Committee 
and  Committee  of  Teachers  and  Curriculum  Developers  to  resolve  dif- 
ferences,  if  review  finds  materials  recommended  for  adoption  unac- 
ceptable [6340.1(IIIC)]. 

Recommendations  of  the  Evaluation  Committee  and  the  Citizens'  Com- 
mittee presented  to  the  County  Board  of  Education  for  final  approval 
[6340.1(IIIB)]. 

A  request  for  review  of  a  required  material  may  be  submitted  by  any 
staff  member  or  citizen  at  any  time.     The  complainant  meets  with  the 
principal  and  the  teacher^ or  other  agent  employing  the  material  in 
question  [6321.1(1)]. 

If  the  initial  meeting  does  not  resolve  the  problem,  the-  principal 
sets  up  a  subcommittee  of  the  Curriculum  Council,  which  meets  and  re- 
views material  on  the  case  (such  material  to  be  provided  by  the  prin- 
cipal) (6321.1). 

The  subcommittee  of  the  Curriculum  Council  generates  a  written  rec- 
ommendation to  the  county  superintendent  [6321. 1(IC4)] . 

'The  couiiLy  8upmi4:tYteH4eafe-^ra3rlfiWS  the  subcommittee's  report  and  sub- 
mits  an  administrative  decision  to  the  County  Board  of  Education 
[6321. 1(ID)]. 

The  complainant  has  the  right  to  go  before  the  County  Board  of  Educa- 
tion to  appeal  the  superintendent's  decision  [6321. 1(IF)] . 

The  County  Board  of  Education  holds  the  legal  authority  for  approval 
of  materials  and  is  required  to  approve  instructional  materials  for 
the  standard  courses  on  an  annual  basis  [6340(1)]. 

Directors  compile  annually  the  catalogue  of  required  materials 
-r^340.1(IIIF)]. —  —  
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to  the  county  Directors  of  Curriculum  [6340, l(IIIC)] •     If  the  Advisory 
Connnittee  report  endorses  the  recommendations  of  the  Committee  of  Teachers 
and  Curriculum  Developers,  the  report  is  presented  to  the  local  board  of 
education  for  final  approval  [6340, l(IIIB)] •    However,  if  the  Advisory 
Committee  has  a  difference  of  opinion  with  the  Committee  of  Teachers  and 
Curriculum  Developers,  the  Directors  of  Curriculum  arrange  a  meeting  of 
the  two  committees  to  resolve  the  differences  and  generate  the  necessary 
consensus  of  action  for  the  LBE  to  finalize  [6340. l(IIIC)]  • 

Jefferson  County  policies  require  that  the  District  Board  pass 
approval  annually  on  all  the  instructional  materials  for  the  schools' 
standard  courses  [6340(1)] •     Board  decisions  are  recorded  by  the  county 
Directors  of  Curriculum,  who  produce  a  catalogue  of  the  approved  materials 
[6340,1(IIIF)]. 

The  staffs  of  each  school  within  the  county  select  materials,  and 
subject  area  coordinators  (see  Figure  X-7  and  Table  X-10)  transmit  this 
information  to  the  County  Director  of  Purchasing  (6340.7).     The  County 
Director  of  Purchasing  is  responsible  for  processing  all  orders  for  the 
materials  (6340.5);  however,  the  Directors  of  Curriculum  are  responsible 
for  ensuring  an  adequate  supply  of  instructional  materials  [6340. 7(IIA)] . 

Instructional  staff  may  order  materials  not  on  the  approval  list. 
However,  unless  the  request  concerns  a  special  pilot  program,  purchase 
of  unapproved  texts  is  usually  limited  to  five  copies  [6340. 5(IIB)] • 

At  any  time  a  staff  member  or  citizen  may  challenge  items  on  the 
county's  approved  list  of  materials  [6321.1(1)].     In  such  circumstances, 
a  meeting  is  set  up  for  the  complainant  with  the  principal  and  the  agent 
using  the  materials  in  question  [6321.1(1)].     If  the  initial  meeting  does 
not  resolve  the  problem,   the  principal  sets  up  a  subcommittee  of  the 
Curriculum  Council  [6321.1)  and  provides  this  subcommittee  with  the 
material  on  the  case  (6321.1).     The  subcommittee  then  generates  a  written 
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Assistant  Superintendent 
for  instructional  Planning 
and  Development 


County  Director 
of  Purchasing 


Principal 


\ Subject  Area 
Coordinators 


School  Staff 


FIGURE  X  7    PROCESS  FOR  SELECTION  AND  INSTALLATION  OF  NEW  MATERIALS: 
JEFFERSON  COUNTY,  COLORADO 

recommendation  to  the  county  superintendent  (6321.1),  who  reviews  the 
recommendation,  makes  an  administrative  decision,  and  duly  informs  the 
County  Board  of  Education  [6321. 1(ID)] •     This  decision  normally  deter- 
mines the  outcome  of.  the  challenge.    When  the  complainant  is  still  dis- 
satisfied, an  appeal  may  be  made  to  the  County. Board  [6321. 1(IF)] . 

Philadelphia  School  District  of  Pennsylvania 

The  process  by  which  the  local  district  conducts  instructional 
materials  selection  and  evaluation  is  extensively  detailed  in  the 
Pennsylvania  education  code  and  was  discussed  previously.     State  policy 
grants  the  Philadelphia  school  board  discretion  to  develop  criteria  for 
evaluating  instructional  materials,  to  establish  contact  with'  publishers, 
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Table  X-10 


POLICIES  AFFECTING  THE  SELECTION  AND  INSTALLATION  OF 
NEW  MATERIALS:     JEFFERSON  COUNTY^  COLORADO 


Subject  area  coordinators  submit  a  list  to  the  Directors  of  Curricu- 
lum of  the  items  and  quantity  needed  in  stock  in  the  county  warehouse 
[6340.7(IA&B)]. 

The  Directors  of  Curriculum  review  the  recommendations  of  the  subject 
area  coordinators  and  transmit  the  information  concerning  the  neces- 
sary warehouse  stock  to  the  Director  of  Purchasing  [6340. 7(IIA)] . 

School  staff  determine  desired  materials^  complete  an  appropriate 
requisition  card^   and  submit  it  to  purchasing  [6340. 5(IA)] . 

For  materials  not  on  the  approved  list^  a  special  purchase  request 
form  is  used.     Normally  schools  are  limited  to  five  copies  of  non- 
approved  texts  except  when  the  order  is  part  of  a  pilot  program 
[6340.5(IIB)]. 

Purchasing  receives  the  requisitions  from  the  schools  and  processes 
the  orders  [6340.5(IB)] . 

The  Assistant  Superintendent  for  Instructional  Planning  and  Develop- 
ment sets  the  priorities  for  district  support  of  new  curriculum  and 
is  responsible  for  the  district  inventory  of  instructional  materials 
[6340.3(1)]. 

The  principals  are  responsible  for  maintaining  records  of  the  re- 
quired materials  in  their  schools  and  for  providing  an  inventory  of 
the  instructional  materials  housed  in  their  schools  (6340.6). 


to  review  available  materials^   and  to  select  and  purchase  materials  (Pa. 
Ed.  Code  8).     As  a  result^   little  is  found  in  Philadelphia  district 
policy  about  how  to  do  these  activities  that  is  not  already  found  in  the 
state  code.     However^  we  do  find  extensive  attention  to  the  actual  doing 
of  the  activities. 

Under  the  rather  awesome  charge  of  the  state  code  that  the  local  dis 
trict  superintendent  recommend  to  the  school  board  materials  for  adoption 
the  Philadelphia  school  board  has  authorized  the  local  superintendent  to 
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establish  an  Instructional  Services  Division,  which  has  the  following 
tasks : 

•  To  create  and  maintain  the  basic  system  of  criteria  to  be 
used  in  selecting  materials. 

•  To  recommend  the  categories  for  which  new  material  should 
be  considered, 

•  To  develop  specific  procedures  by  which  publishers  may  sub- 
mit their  materials  for  review  and  to  make  purchases  when 
authorized  by  the  board, 

•  To  organize  review  panels  for  some  35  categories  of 
materials. 

•  To  transmit  the  specific  recommendations  to  the  superin- 
tendent for  submission  to  the  board. 

The  Instructional  Services  Division  transmits  to  each  of  the  material--, 
review  panels  the  set  of  general  instructional  materials  criteria  estab- 
lished by  the  state  code  and  the  local  district  board,  plus  any  additional 
criteria  specific  to  the  material  reviewed  by  that  panel  (for  example, 
the  state  provisions  for  teaching  American  government). 

Each  panel  consists  of  several  volunteer  teachers  in  the  subject 
under  review.     Materials  are  submitted  to  them  by  mid-October,   and  they 
return  their  recommendations  for  acceptable  products  as  quickly  as  possible. 
Materials  then  accepted  by  the  board  are  put  on  file  at  the  official  bid 
price,  which  accompanied  the  publisher's  original  submission  of  material. 
Teachers  may  select  materials  from  this  list  in  the  spring,  before  May  1. 
The  samples  of  materials  submitted  for  review  are  maintained  in  the 
''Textbook  and  Instructional  Aids"  section  of  the  Pedagogic  Library  in  the  • 
school  administration  building,  where  all  school  personnel  and  the  public 
can  examine  them. 
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Dade  County  School  District  of  Florida 


The  selection  of  instructional  materials  in  Dade  County  must  be 
divided  into  the  selection  of  instructional  materials  from  the  state- 
approved  list,  and  the  selection  of  nonapproved  materials  within  state 
guidelines.     The  selection  of  materials  from  the  state-approved  list  is 
straightforward  and  entails  little  local  district  policy.     This  process 
was  discussed  previously.     Selection  of  nonapproved  materials  entails 
more  complex  local  policy  and  must  be  divided  into  selection  of  nonapproved 
commercial  publications,   and  selection  of  materials  created  within  the 
district  by  district  personnel. 

Table  X-11  summarizes  the  basic  policies  that  characterize  Dade 
County  and  the  other  two  districts  under  study. 

Conclusions  for  Federal  Policymaking  ^ 

This  review  of  the  final  decision  makers  in  the  instructional  materi- 
als selection  and  evaluation  process  leaves  two  strong  impressions. 
First,  great  differences  exist  from  state  to  state  and  from  district  to 
district  in  the  manner  of  exercising  choice  and  in  the  criteria  preferred. 
Second,   these  differences  cannot  be  explained  by  policies  reacting  in  a 
cause  and  effect  chain;  that  is,  those  policies  that  do  mark  a  difference 
are  not  easily  manipulated.     They  are  the  symbols  of  a  collective  politi- 
cal effort,  which  must  be  manipulated  by  a  complex  political  process. 

This  observation--that  most  key  policies  should  be  seen  as  effects, 
not  causes,  of  basic  choices-- leads  to  two  questions:     "How  are  these  key 
policies  formed?"  and  "How  might  one  go  about  changing  them?"    Such  ques- 
tions require  a  more  detailed  review  of  the  actors  who  set  policies  at 
the  various  governance  levels,  which  is  discussed  in  the  following  sec- 
tion. 
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IV    EXPLAINING  INSTRUCTIONAL  MATERIALS  SELECTION  AND 
EVALUATION  DECISIONS:     THE  CONFIGURATIONAL  APPROACH 


How  much  of  the  instructional  materials  selection  and  evaluation  de- 
cision process  have  we  explained  by  looking  at  policy-determined  struc- 
ture in  the  previous  sections?    Koerner  (1968)  offers  the  following 
anecdote^  which  suggests  the  answer: 

Suppose  a  local  board,  aware  of  the  obsolescence  and  flac- 
cidity  of  much  that  passes  for  vocational  training  •••  de- 
cides to  reduce  its  program  in  these  areas.     In  theory  this 
is  one  of  its  sovereign  rights.    In  practice  several  things 
occur  to  change  its  mind.     First,  the  vocational  education 
lobby  goes  to  work  on  other  members  of  local  government  and 
on  the  state  legislature  or  state  department  of  education  to 
protect  the  extensive  interests  of  'vocational  education 
teachers  [and  equipment  producers].     Second,  the  regional 
accrediting  association  comes  to  the  aid  of  the  status  quo 
and  makes  threatening  noises,   suggesting  and  then  perhaps 
demanding,   on  pain  of  disaccreditation  ,,,   that  the  toard 
rescind  its  decision.     Third,  the  NEA  state  affiliate  "in- 
vestigates" and  through  its  considerable  power  "persuades" 
the  board  to  a  different  view. 

For  better  or  worse,  the  decisions  by  the  designated  instructional 
materials  decision  makers  take  place  in  a  complex  environment.  As 
Koerner 's  story  shows,  there  are  t)ther  agents  surrounding  and  actively 
employing  policy  strings  to  affect  the  local  board's  choice. 

With  a  little  imagination,  we  can  see  that  Koerner  has  listed  only 
a  few  of  the  possible  complications  and  that  these  complications  occur 
at  all  decision  levels,  beginning  at  the  federal  level.     Other  agents 
(special  interest  groups)  who  exert  pressure  on  policy  decisions  relative 
to  instructional  materials  are  shown  below: 
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•  Religious  sects. 

•  Political  groups  (Blrchers,  ACLU,  and  others). 

•  Labor  unions  (AFL-CIO). 

•  Teachers  unions  (NEA,  AFT). 

•  Ad  hoc  parent  groups  (as  In  West  Virginia). 

•  Colleges/universities. 

•  Publishers. 

•  PTA. 

•  Regional  accrediting  agencies. 

•  Professional  accrediting  agencies. 

•  Foundations. 

•  Other  government  branches  and  agencies  (especially  military 
and  NSF). 

•  Local  and  national  mass  media. 

•  Special  education  groups  (vocational  education  and  others). 

•  Private  schools, 

•  Proprietary  schools. 

•  Business  (especially  employers), 

•  Testing  services^ 

•  Education  professors/education  critics. 

In  this  section  we  present  a  strategy  for  capturing  more  of  the 
complex  configuration  of  agents  and  policies  that  form  the  real-world 
environment  for  those  instructional  materials  decision  makers  Identified 
in  Section  III,      Based  on  the  de  facto  specialization  of  instructional 


Because  this  expansion  of  the  configuration  adds  significantly  to  the 
numbers  of  policies  and  agents  that  must  be  organized  and_ because  the 
resources  of  our  project  were  to  be  directed  only  to  development  of  an 
analytic  framework  (not  to  the  conduct  of  a  deflnitiye  study  of  Instruc 
tlonal  materials  selection),  only  the  layout  for  the  next  step  in  this 
analysis  will  be  developed. 
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materials  manufacture  and  assessment  as  separate  industries,  we  will  add 
to  the  basic  configuration  (see  Figure  X-1)  two  more  dimensions:  agents 
directly  concerned  with  production  of  materials,  and  agents  directly  con- 
cerned with  establishing  standards  and  criteria  for  selection  and  evalua- 
tion (see  Figure  X-8), 

Two  more  sets  of  policy  immediately  become  relevant.     First  is  the 
policy  from  higher  governance  levels  that  affects  the  boundaries  and 
domains  of  publishers  and  assessment  agents,   and  establishes  the  framework 
for  the  interfaces  between  them  and  with  the  main- line  education  agents 
(see  arrows  from  A  to  D  and  E  in  Figure  X-8),     Second  is  the  policy  nego- 
tiated on  the  same  governance  level  among  publishers,  assessment  agents, 
and  education  system  agents  (see  arrows  from  B  to  D,  B  to  E,   and  D  to  E). 
We  present  below  the  investigative  format  called  for  by  the  analytic 
framework  to  complete  the  next  steps  in  the  analysis. 

Expanding  the  State-Level  Configuration 

Although  we  have  shown  that  policies  and  decisions  relative  to  in- 
structional materials  exist  at  federal,   state,  and  local  levels,  we  will 
use  only  the  state  level  here  as  a  model  for  the  next  step.     Because  the 
Colorado  Constitution  passes  almost  total  responsibility  to  the  local 
district  level,  we  will  take  most  of  our  examples  from  the  Pennsylvania 
and  Florida  cases. 

The  steps  through  which  this  next  phase  of  the  analysis  should  pro- 
ceed follow  directly  from  the  analytic  framework: 

(1)  Sharpen  the  specification  of  the  important  agencies  in  the 
focus  of  analysis  (Step  2  of  framework). 

(2)  Identify  the  publishing  and  assessment  agencies  that  deal 
with  agents  in  the  focus  of  analysis,  by  looking  at  the 
roles  and  policies  in  the  focus  (Step  3  of  the  frame- 
work). 

I 
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Publishers  and  Material 
Manufacturers, 
Publishing  and  Material 
Manufacturing  Interests, 
Their  Associations  and 
Coalitions. 


Fundamental  Sources 
of  Authorization 


Main  Line  Education 
Agencies  at  the 
Governance  Level 
Being  Analyzed. 


(§)  Assessment  and  Testing 
Agencies,  Their  Associa- 
tions and  Coalitions. 


/ 

r^i^ower  Levels  of  Main  Line  Governance^ 
'  Impacted  by  the  Level  Being  Analyzed  ' 
I  J 


Note:  Compare  this  figure  with  Figure  X-l,  which  describes  the  set  of  policies  in  the  main  line  instructional 
materials  selection  and  evaluation  process.  Note  that  we  now  emphasize  the  policies  between  the  IM 
suppliers  and  the  agents  supplying  criteria  for  IM  evaluation. 


FIGURE  X-8   A  GENERAL  GRAPHIC  FOR  SHOWING  AN  EXPANDED  CONFIGURATION  OF  THE 
INSTRUCTIONAL  MATERIALS  SELECTION  AND  EVALUATION  PROCESS 
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(3)  Identify  the  policy- specif ied  configuration  linking  the 
three  sets  of  agents  (Step  4  of  the  framework). 

(4)  Identify  the  important  authorizing  agents  and  policies 
overriding  this  configuration,  by  looking  at  histories 
of  the  policies  identified  in  Step  (2)  above  (Step  3  of 
the  framework), 

(5)  Identify  the  policy  configuration  authorizing  the  pattern 
of  behavior  at  the  governance  level  of  the  focus  of 
analysis  (Step  4  of  the  framework), 

(6)  Test  the  adequacy  of  the  configuration  against  the  pur- 
poses of  analysis;  that  is,  does  the  configuration  fully 
describe  how  responsibility  for  instructional  materials 
selection  and  evaluation  is  divided  and  organized  at  this 
level  of  governance?  (Step  5  of  the  framework). 

Sharpening  the  Focus 

To  develop  a  sharper  focus  for  this  phase  of  the  analysis,  we  need 
only  turn  back  to  the  figures  in  Section  III  that  pertain  to  the  state 
in  question.     From  Figure  X-3,  for  example,  we  can  see  that  the  principal 
actors  at  the  Florida  state  level  of  educational  governance  are: 

•  The  Florida  State  Legislature 

•  An  elected  Commissioner  of  Education 

•  The  State  Board  of  Education 

•  The  State  Department  of  Education 

•  The  Instructional  Materials  Councils. 

With  this  much  clarity,  we  can  go  to  the  policy  archives  for  types 
of  policies  that  might  link  any  of  these  groups  with  the  publishing  or 
assessment  sectors.     Reference  to  the  analytic  framework's  taxonomy  of 
formal  policies  suggests  that  we  ought  to  look  for  potentially  significant 
formal  policies  of  the  following  types  for  each  of  the  five  groups: 

•  State  Legislature:     Statutes  (for  example,  license  require- 
ments), regulations. 
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•  Commissioner:    Discretionary  acts. 

•  State  Board:    Regulations^  contracts,  guidelines. 

•  State  Department:    Regulations,  contracts,  guidelines. 

•  Materials  Councils:    Association  memberships. 

Identifying  Important  Publishing  or  Assessment  Agencies 

Because  policies  give  information  on  the  parties  involved  and  their 
relationship,   the  policies  linking  educators  with  publishers  and  assessors 
can  be  used  to  identify  the  latter.     Therefore,  by  exhaustively  examining 
each  of  the  types  of  material- relevant  policy  to  which  state-level  agents 
are  a  party^   the  identification  of  publishers  and  assessors  should  be 
complete. 

Data  gathering  for  the  main- line  analysis  (described  in  Section  III) 
provided  two  insights.     The  first  is  that  some  shift  is  occurring,  with 
states  (and  districts)  slowly  assuming  more  responsibility  for  assessment 
and  a  little  more  responsibility  for  materials  manufacture;  howeVier, 
private-sector  interests  still  dominate  in  both  realms.     The  second  in- 
sight resulted  in  the  following  preliminary  list  of  publishing  agencies 
(on  the  left)  and  assessment  agencies  (on  the  right): 

Publishing  houses  Accreditation  agencies,  both 

professional  and  regional 


Independent  printers 
Wholesalers 
Retailers 

Athletic  equipment  suppliers 


Testing  services 

The  National  Assessment 

Special  interest  groups 


This  process  will  turn  up  yet  other  agents  who  might  be  important  if 

the  analysis  has  to  proceed  through  another  cycle  of  expansion  to  satisfy 

a  more  global  analytical  purpose. 
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Vocational  education  and  special 
education  specialty  firms 


Laboratories  and  centers, 
when  so  contracted 


Laboratories  and  centers,  when 
so  contracted 


The  Conf iffliration  of  Publishers,  Assessors,   and  Educators 


Having  identified  both  the  relevant  policies  and  agents  in  the  pre- 
vious step,   one  can  now  develop  a  map  of  the  overall  pattern  of  their 
relationships.    Unfortunately,  even  if  the  analyst  has  gathered  all  the 
information  possible,   the  map  will  probably  be  neither  complete  nor  con- 
sistent.     This  problem  arises  because  real-world  policy  systems  are 
typically  neither  complete  nor  consistent,  particularly  when  the  subject 
is  complex  and  heavily  value-laden. 

Undoubtedly,  however,   this  effort  will  show  that  a  set  of  overriding 
policies  from  more  fundamental  sources  of  authority  is  necessary  to  smooth 
the  working  relations  among  publishers,   assessors,   and  educators  and  pro- 
vide channels  for  resolving  conflicts  and  inconsistencies..    Moreover,  the 
configuration  found  in  this  step  is  probably  precluded  from  changing  in 
certain  ways  by  these  more  fundamental  policies.     If  the  analyst  wants  to 
find  how  to  change  the  basic  shape  of  a  configuration,  he  will  have  to 
explore  these  policies,  which  leads  to  the  next  step. 

Identifying  the  Fundamental  Sources  of  Authority 

Identifying  the  sources  of  authority  underpinning  the  agent/policy 
structure  at  a  given  governance  level  is  a  straightforward  but  time- 
consuming  process.     Essentially,   it  requires  tracing  the  policies  and 
role  specifications  to  their  sources.       In  identifying  the  underpinning 


See  Sections  IV,  V,  and  VI  of  the  bibliography. 
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for  the  state- level  configuration  of  instructional  materials  decision 
responsibility^  our  main- line  analysis  showed  that^  at  minimum^   the  fol- 
lowing are  contributing  authority  sources: 

•  Constitutional  law 

-  Federal 

-  State 

•  Branches  of  federal  government 

-  Congress 

-  President 

-  Supreme  Court 

•  Federal  agencies 

-  DoD 

-  Civil  Service  Commission 

-  USOE 

-  NIE. 

Because  the  authorizing  policies  that  might  be  relevant  run  the  full 
gamut  of  our  policy  taxonomy^  we  must  proceed  from  the  policy/agent  con- 
figuration of  the  previous  analytic  step  through  the  structure  of  the 
formal  policy  codification  and  indexing  system  to  those  most  relevant. 

Our  investigation  turned  up  two  sets  of  significant  authorizing 
policy.     One  is  the  copyright  law  that  allows  publishers  to  "protect'*' 
their  ownership  of  knowledge  in  a  salable  form;  the  other  is  the  federal 
recognition  and  use  of  private  accreditation  association  judgments  in 
accepting  personnel  into  the  military  and  the  civil  service. 


Identifying  the  Configuration  of  the  Three  Groups 

The  final  step  in  this  cycle  of  analysis  would  be  to  combine  the 
configuration  of  the  three  groups  of  agents  at  the  given  level  with  the 
authorizing  agents  and  policies. 
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Testing  the  Configuration  Against  the  Analyst's  Purpose 

If  reflection  shows  the  analyst  that  his  configuration  provides 
enough  information  to  meet  his  needs^  his  task  is  complete*     On  the  other 
hand,  if  he  has  unanswered  questions,  he  must  decide  how  best  to  direct 
expansion  of  the  analysis*    Clearly,  in  this  case,  he  might  expand  the 
analysis  by: 

•  Shifting  the  governance  level  being  analyzed. 

•  Shifting  the  focus. 

-  Expanding  or  contracting  the  focus* 

-  Shifting  to  a  more  detailed  analysis  of  publishers  or 
assessors. 

•  Expanding  the  configuration  to  Include  more  of  the  specific 
environment  surrounding  publishers,   assessors,  and  edu- 
cators* 
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V    IMPLICATIONS  CONCERNING  THE  INSTRUCTIONAL  MATERIALS 

ADOPTION  SYSTEM 

The  policy  descriptions,  particularly  those  in  Section  III,  support 
a  variety  of  implications  about  the  instructional  materials  selection  and 
evaluation  process.-   We  will  discuss  three  of  these  below. 

Implications  for  the  Instructional  Materials  Selection  and  Evaluation 
Process 

The  Structure  of  the  Decision  Process 

Probably  the  most  profound  implication  relative  to  the  established 
innovation  literature  is  that  adoption  of  new  instructional  materials  is 
not  permitted  if  based  on  isolated  individual  judgment.     Individual  edu- 
cators are  not  free  to  make  decisions  as  are  farmers  or  doctors.  More- 
over, the  more  an  innovation  deviates  from  products  the  adoption  system 
is  designed  to  handle  (for  example,  films  or  manipulatives  in  place  of 
textbooks),  the  more  complex  the  decisions  necessary  for  adoption  and  the 

less  likely  that  local  education  agents  such  as  teachers  or  principals  ' 

 "  """"   "     ■  ~~  ^  ^ 

will  be  allowed  individually  to  make  the  adoption  decision. 

To  maintain  continuity  of  practice  and  consensus  among  parents  and 
educators,  a  network  of  controls  over  instructional  materials  adoption 
has  evolved.    This  network  of  controls  seldom  allows  determinations  to 
be  made  by  one  agent  or  one  policy  but  encourages  convergence  of  policies 


Even  for  conventional  materials,  the  Institute  for  Educational  Develop- 
ment. (1969)  found  that  teachers  are  usually  allowed  to  exercise  choice 
only  in  small  groups  at  the  school  site  or  district  level,  subject  to 
veto  and  informal  sanctions  from  the  principal  or  superintendent, 
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and  agents  to  produce  results.    Thus,  selection  is  not  the  result  of  mono- 
lithic decisions  but  of  accumulations  of  many  judgments  on  different 
characteristics  by  different  agents  organized  in  many  unique  ways. 

Characteristics  Evaluated 

The  policies  that  regulate  the  selection  process  are  divisible  into 
three  orientations.     Some  policies  focus  on  who  may  make  which  decisions 
(see  Pennsylvania  case);  typically  these  policies  assign  a  particular 
aspect  of  the  overall  judgment  to  a  given  actor.     Other  policies  focus 
on  which  characteristics  of  the  material  should  be  judged,  regardless  of 
who  does  the  judging.     Finally,  some  policies  regulate  what  constitutes 
an  acceptable  solution. 

In  particular,  the  Florida  case  shows  that,  although  teachers  are 
allowed  final  approval  and  always  have  a  veto  power  over  the  use  of  a 
material,   they  have  little  information  by  which  to  distinguish  among,  let 
us  say,  five  options  in  the  state- approved  materials  catalogue.     In  fact, 
almost  the  only  judgments  left  are  "How  easily  can  I  master  the  use  of 
this  material?"  and  "Will  it  stand  up  to  the  sort  of  wear  my  students 
will  give  it?" 


Using  Policy  Knowledge  in  Dissemination  Planning 

The  final  category  of  implications  for  the  process  itself  is  that 
pertaining  to  the  design  of  products  and  strategies  for  their  dissemina- 
tion.    In  many  cases,  adjusting  the  product  to  the  setting  may  be  wiser 
than  lamenting  that  the  setting  resists  the  product.     Because  many  levels 
of  governance  attend  to  various  product  characteristics.  It  Is  likely 

In  fact,  these  are  precisely  the  questions  the  Institute  for  Educational 
Development  1969  study  on  the  Selection  of  Educational  Materials  In  the 
United  States  Public  Schools  found  teachers  to  be  addressing. 
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that  failure  to  attend  to  instructionally  insignificant  but  important 
policy-related  characteristics  durinfThe  design  or  dissemination  phase 
causes  products  to  be  rejected  for  spurious  reasons.     Attention  to  policy 
compatibility  might  pay  off  as  much  in  improved  dissemination  as  does 
attention  to  the  basic  research  underlying  the  product.     All  features  of 
a  proposed  product  should  be  assessed  for  policy  compatibility  by  asking 
if  the  feature  is  policy- favored,   policy-prohibited,   or  policy-aeutral. 

Issues  Unaddressed  in  This  Analysis 

Identifying  important  questions  that  have  been  overlooked  in  a  study 
is  sometimes  difficult.    However,   in  this  study  one  problem  is  clear. 
Because  the  number  of  governance  levels  and  the  cases  examined  were  so 
severely  limited,   it  is  difficult  to  form  any  holistic  impressions  of  the 
instructional  materials  selection  and  evaluation  network. 

A  second  limitation  is  the  restricted  definition  of  "instructional 
material"  and  the  limited  range  of  agents  considered  in  any  depth.  The 
full  possible  range  of  curriculum  matters  [as  identified,  by  Dr.  Sixten 
Marklund  (1975)]  is  shown  below: 

(1)  NatlOTal/ state  school  laws  and  regulations. 

(2)  Compulsory  schooling. 

(3)  Structure  of  diversification. 

(4)  Lines,  streams,   grades,  relations  between  primary  and 
secondary,   and  so  forth. 

(5)  Guidance,   special  education. 

(6)  Subjects,  major  content. 

(7)  Specific  content,  courses,  individualization. 


*Items  (5)  through  (13)  fall  within  the  domain  of  research  and  develop- 
ment in  the  American  system. 
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(8)  Methods  of  teaching  and  learning. 

(9)  Textbooks,  learning  aids,  school  equipment. 

(10)  Testing  and  evaluation. 

(11)  Cooperation:  school/industry/business. 

(12)  Cooperation:  school/home. 

(13)  Cooperation:     students /teachers. 

This  full  range  of  curriculum  matters  and  the  list  of  other  interested 
agents  suggest  that  a  broader  analysis  might  reveal  important  intercon- 
nections between  this  process  and  the  education  system  in  which  it  lies. 
Unfortunately,  each  such  expansion  of  analytic  scope  causes  a  geometric 
increase  in  the  amount  of  policy  that  must  be  considered.     A  thorough 
investigation  of  the  concept  would  require  broadening  attention  in  at 
least  three  ways.     Attention  should  be  given  to: 

•  A  broader  concept  of  instructional  materials  that  includes 
structure  of  school  day  and  year,  use  of  public  and  indus- 
trial plants  as  learning  sites,  selection  of  personnel  as 
biasing  choice  among  materials,   and  so  forth. 

•  The  emergence  of  a  fourth  task,  "program  evaluation,"  in 
parallel  with  publishing,  assessment,  and  selection. 

•  The  coordination  of  materials  decisions  with  the  full  range 
of  curriculum  matters,  both  because  of  a  need  for  compati- 
bility and  because  of  the  growing  competition  for  limited 
education  funds. 

Implications  for  Federal  Agencies 

Our  strongest  impression  from  this  analysis  is  that  the  selection 
process,  while  convoluted,  is  far  from  sophisticated.    This  lack  of  _ 
sophistication  probably  arises  from  the  continual  pressure  in  our  system 
to  attend  to  the  education  process  itself  and  not  to  the  management  of 
that  system.     This  observation  is  supported  by  policies  follcn^ed  in  the 
late  1960s  to  create  "teacher- proof "  materials  and  "SEA-LEA-proof"  dis-^ 
semination  strategies.    The  greatest  need  at  this  time  is  for  attention 
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and  resources  to  be  directed  toward  developing  the  governance  system  of 
education^  as  opposed  to  continual  research  in  materials  for  children  to 
use* 

Unfortunately,  this  concept  flies  in  the  face  of  a  basic  philosophy 
that  educators  have  adopted--that  education  and  politics  should  be  as 
separate  as  are  church  and  state.     In  fact,  many  of  the  decisions  made  by 
educators  are  matters  of  value  judgment  that  deserve  attention  as  such; 
such  decisions  should  not  automatically  be  delegated  to  professionals  as 
if  they  were  technical  matters.     To  get  better  decisions  on  materials, 
we  must  improve  the  quality  of  the  decision-making  process. 


X-61 


508 


Annex  A 

THE  USE  OF  THE  ANALYTIC  FRAMEWORK  IN  THIS  CASE  STUDY 


Annex  A 

THE  USE  OF  THE  ANALYTIC  FRAMEWORK  IN  THIS  CASE  STUDY 

About  the  Methodology  Generally 

The  conceptual  system  used  to  guide  the  inquiry  for  this  case  study 
is  a  newly  developed  methodology  called  the  Analytic  Framework  for 
Education  Policy  Analysis.     A  thorough  discussion  of  this  methodology, 
its  origins,   and  its  foundations  in  the  philosophy  of  inquiry  is  pre- 
sented in  Volume  I  of  this  report.    A  brief  description  can  be  found  in 
Mandel  and  Markley  (1975).     This  annex  is  only  a  discussion  of  how  the 
methodology  was  used  to  shape  this  specific  inquiry. 

The  methodology  has  five  steps  through  which  one  repeatedly  cycles, 
until  it  is  possible  to  say  the  tapestry  is  complete.     If  the  analyst  has 
chosen  some  subject  of  interest  in  which  he  believes  the  major  elements 
are  human  agents,  policies,  goal-oriented  activities,  and  related  resources 
he  will  find  the  analytic  framework  appropriate  for  guiding  his  inquiry. 
The  framework  suggests  he  proceed  through  the  following  steps; 

(1)  Clarify  the  reason  for  the  analysis,  both  in  terms  of  the 
intended  audience  and  a  best  guess  at  the  main  problem. 

(2)  Select  a  focus  and  field  of  analysis.     The  world  is 
usually  too  complex  to  collect  all  the  data  about  a  sub-, 
ject,   so  one  must  identify  those  elements  that  are  most 
likely  to  be  significant  or  those  that  require  the  most 
detailed  knowledge. 

(3)  Begin  collecting  specific  data  about  the  elements.  Selec- 
tion from  a  variety  of  data  collection  methods  becomes  . 
important  here,  depending  on  the  elements  and  the  purpose 
of  analysis-- survey  analysis,  anthropological,  legal 
archival,  or  the  like. 
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(4)  Begin  pulling  the  evidence  together  to  weave  an  image 
of  the  system  under  consideration.     Use  a  variety  of 
configuration  maps  and  cycle  through  Steps  (3)  and  (4) 
until  the  maps  **feel"  complete. 

(5)  Reflect  on  the  power  of  the  maps  to  satisfy  the  purpose 
of  analysis.    Depending  on  the  adequacy^  refine  the  pur- 
pose ^pf  analysis^  Step  (1)^   and  the  focus  of  analysis^ 
Step  (2)^  as  needed^  and  repeat  Steps  (3)>   (4)^  and  (5) 
until  a  satisfactory  outcome  is  reached. 

How  the  Methodology  Was  Used  to  Conduct  This  Inquiry 

This  analysis  was  conducted  by  following  the  five  steps  mentioned 
above.    However,  reconstruction  of  events  shows  three  full  cycles  through 
the  steps# 

In  the  first  cycle,   Section  II  was  outlined.     The  following  prelimi- 
nary statement  of  purpose  was  formed: 

Identify  the  role  of  policies  in  determining  curriculum  re- 
form through  instructional  materials  innovation. - 

Then  the  overall  structure  of  the  approach  was  laid  out.    Elements  for 
study  were  selected,  and  a  plan  for  mapping  their  connections  was  de- 
veloped.    Reflection  on  the  likelihood  of  the  approach  to  reach  the  goal 
revealed  no  major  obstacles. 

The  second  cycle  began  with  the  attempt  to  collect  the  data  for  Sec- 
tion III.    However,  the  first  serious  problem  immediately  surfaced.  The 
purpose  of  analysis  and  the  focus/field  of  analysis  first  chosen  were  so 
broad  that  they  yielded  too  much  material  and  required  more  resources 
than  were  available  for  the  study.     So  the  purpose  of  analysis  was  further 
refined : 

What  policies  control  the  structure,  process,  and  outcomes  of 
the  instructional  materials  selection  and  evaluation  process? 
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Because  much  work  in  excess  of  available  resources  was  still  required, 
the  focus  and  field  of  analysis  were  further  limited  to  include  only  the 
seven  formal  levels  of  educational  governance,  as  seen  at  the  federal 
level  and  in  three  states  (see  Annex  C). 

Data  collection  was  resumed.    However,   a  study  of  formal  policy 
records  soon  revealed  that  only  three  governance  levels  (the  federal, 
the  state,  and  the  local  district)  had  significant  roles  in  selecting  in- 
structional materials.     Since  the  study  was  being  conducted  as  a  test  of 
the  analytic  framework  and  as  a  preliminary  feasibility  study  for  a 
comprehensive  study,  the  importance  of  these  three  governance  levels  was 
used  to  further  limit  the  purpose  of  analysis: 

What  policies  control  the  structure,  process,  and  outcomes  of 
the  instructional  materials  selection  and  evaluation  process 
at  the  federal  level;  at  the  state  level  in  Colorado,  Florida, 
and  Pennsylvania;  and  at  the  district  level  for  one  district 
in  each  of  these  states? 

The  analysis  was  then  completed  (see  Section  II). 

Reflection  on  the  adequacy  of  the  analysis  in  Section  III  [as  called 
for  in  Step  (5)  of  the  analytic  framework]  suggested  two  inadequacies. 
Indeed,  the  story  seemed  too  narrow  in  light  of  what  we  knew  from  talking 
to  educators  in  the  three  states.    First,  despite  the  apparent  power  and 
smooth  structure  of  the  formal  selection  and  evaluation  process,  we  were 
told  it  did  not  actually  work  that  way.     Second,  we  were  told  that  two 
other  processes- -that  also  strongly  affected  the  outcomes — were  occurring 
in  parallel  with  instructional  materials  selection  and  evaluation  (pub- 
lishing and  assessment).     Therefore,  we  again  modified  the  purpose  of 
analysis: 

What  policies  from  the  governance  levels  already  studied  per- 
tain to  the  tasks  of  publishing  and  assessment  so  as  to  in- 
directly but  strongly  affect  the  instructional  materials 
selection  and  evaluation  process? 


Using  this  purpose^-  we  set  up  the  third  cycle  of  analysis^   as  discussed 
in  Section  IV. 

How  the  Analytic  Framework  Was  Tested  in  This  Case  Study 

An  approach  to  conceptualizing  a  problem  must  be  judged  in  at  least 
two  ways.     First^  if  one  steps  back  from  the  effort  and  views  it  within 
his  total  experience^  does  it  contribute  something  positive  overall?  Is 
that  ^'something"  worth  the  effort?    Second^   if  one  assesses  specific 
features^  characteristics^  or  parts  of  the  approach_,  do  they  contribute 
positively  to  the  overall  product?    Are  they  worth  the  effort? 

This  case  study  should  be  used  to  test  the  analytic  framework  pri- 
marily in  the  first  way.     The  authors  are  satisfied  that^  overall^  the 
approach  yielded  worthwhile  results.     The  reader  may  not  agree.    We  sug- 
gest three  questions  the  reader  might  ask  in  making  his  judgment: 

•  Did  the  approach  identify  and  organize  the  important  ele- 
ments and  configurations  in  instructional  materials  selec- 
tion and  evaluation? 

•  Did  the  approach  reveal  the  major  sources  of  policy  prob- 
lems? 

•  Does  the  approach  allow  one  to  extrapolate  the  appropriate 
"next  steps"  for  tasks  such  as  planning  NIE's  role  in  this 
process^  or  assessing  the  desirability  of  a  more  thorough 
study? 
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INCIDENTAL  OBSERVATIONS  ON  THE  ROLE  OF  POLICY 
IN  INSTRUCTIONAL  MATERIALS  SELECTION  AND  EVALUATION 

Following  is  a  collection  of  observations,  questions,  and  tentative 
hypotheses  formed  during  the  development  of  this  topic.    They  are  orga- 
nized into  three  sections: 

•  Tentative  conclusions  about  the  effects  of  the  policy- 
specified  structure  of  decision  making  responsibility 
for  materials, 

•  Tentative  conclusions  about  policies  affecting  specific 
decisions  on  innovations  in  instructional  materials. 

•  Tentative  conclusions  about  existing  or  needed  trends  in 
our  (NIE's)  approach  to  instructional  materials  policy. 

Following  are  tentative  conclusions  about  the  effects  of  the  policy- 
specified  structure  of  decision  responsibility. 

(1)  In  descending  order  of  authority,  the  state  level,  the 
local  level,  and  the  school  site  have  direct  opportunity 
to  expand  or  modify  curriculum. 

(2)  Their  options,  many  of  the  criteria  they  must  use,  and 
even  their  right  to  choose  are  typically  set  outside  their  ' 
control  at  every  level. 

(3)  Single  specific  policy  changes  can/may  not  have  much 
effect  on  curriculum  (except  those  mandating  a  specific 
new  practice  at  the  microlevel). 

(4)  Most  instructional  materials  decision  makers  are  formally 
granted  large  domains  of  freedom,  but  cannot  take  advan- 
tage of  them  because  (a)  informal  norms  limit  them,  (b) 
they  lack  energy/courage/imagination,  or  (c)  formal 
policy/products/activities  overlap  from  the  three  co- 
ordinate task  areas  (publishing,  assessment,  main-line 

•  education). 
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(5)  The  structure  has  built-in  disincentives  toward  pluraliza- 
tion  of  instructional  material  content  and  types,  particu- 
larly from  ^^standardizing"  assessment  agencies. 

(6)  Conversely,  the  structure  does  have  built-in  incentives  to 
select  noncontroversial  instructional  material  (Wirt  and 
Kirst,  1972,  p.  33). 

(7)  Curriculum  change  takes  place  in  a  loose  but  highly  fo- 
cusing system;  therefore,   only  a  few  changes  can  get 
through  all  the  steps. 

(8)  Innovation  in  instimctional  materials  should  be  viewed 
from  the  state  and  federal  levels  as  a  political  rather 
than  a  rational  EKPU  process  (the  latter  view  tends  to 
let  only  a  few  have  any  voice).     Instructional  materials 
have  open  and  hidden  value  as  well  as  technical  componeivts 
and  therefore  deserve  political  attention. 

(9)  Adoption  of  instructional  materials  is  a  multistep  process 
it  requires  a  concert  of  decision  makers  at  different 
levels  with  different  values. 

(10)  Until  state  government  and  federal  government  undergo 
transformations  to  (a)  value  educational  pluralism  and 
(b)  attend  to  policies  governing  the  structure  of  in- 
structional materials  selection  and  evaluation,  little 
change  will  occur  in  the  types  of  instructional ^materials 
adopted. 

(11)  Little  structural  opportunity  exists  for  the  community  to 
address  the  value  aspects  of  instructional  materials  selec- 
tion and  evaluation. 

(12)  No  structural  mechanism  is  designed  to  cope  with  the  ten- 
sion of  providing  both  shared  and  pluralistic  educational 
experiences.     This  problem  is  compounded  by  educational 
reforms  of  the  early  1900s  and  our  resulting  preference 
for  resolving  curricular  problems  through  compromise. 
Therefore,  we  "solve  the  problem"  by  turning  to  the  in- 
structional materials,  subjects,  and  methods  having  the 
lowest  denominator  of  conflict. 

(13)  More  politics  in  instructional  materials  selection  and 
evaluation  does  not  mean  decentralization  or  centraliza- 
tion.   The  problem  is  hierarchic.    We  need  a  strong 
central  guarantee  of  localism  and  support  of  differ- 
entiation locally,  and  organization  at  the  local  leyel  by 
values  and  interests.    Currently,  this  can  be  accomplished 
only  by  those  who  can  afford  private  schools. 
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(14)  Pluralistic  differentiation  of  education  at  and  among 
school  sites  requires  districts  large  enough  and  co- 
ordinated enough  to  support  specialization,  while  re- 
taining efficiency,  opportunity,   and  freedom.  Therefore, 

_the_rjgLle_of_£ederal--pol-icy— sh^^^  al 
from  value  issues  at  state  and  local  levels  and  to  help 
complex  governance  structure  evolve.     (This  does  not  mean 
an  increase,  but  a  decrease,  in  central  staff.)     A  central 
problem  is  that  we  still  have  a  decision  structure  too 
simple  for  the  complexity  of  value  issues  entailed. 

(15)  The  structures  for  assessment  and  for  reporting  results 
to  the  public  must  be  improved. 

(16)  An  ideal  structure  for  local  innovativeness  relative  to 
instructional  material  would  have: 

(a)  A  large  district  (20  sites)  differentiated  by  site, 
with  a  "differentiate"  mandate  from  the  state. 

(b)  Some  basic  districtwide  criterion-reference  testing. 

(c)  School- site  control  of  curriculum  and  instructional 
material,   and  full  parental  choice  of  school  site 
for  their  children  (supported  by  public  transporta- 
tion). 

(d)  Technical  issues  separated  from  value  issues  and 
both  discussed  in  parent /teacher  councils. 

(e)  Districtwide  teacher  negotiation  of  wages  and  fringe 
benefits. 

(f)  School- site  hiring  of  teachers  based  on  philosophy 
compatibility  ("3  Rs"  at  one  site,  "free,  school"  at 
another,  and  so  forth). 

(g)  Site  hiring  of  principal  (concurrence  of  school  site, 
parents,  teachers,  and  LBE). 

(h)  School  board  members  who  are  elected  on  policy  advo- 
cacy roles  and  are  paid  a  salary  making  the  job 
accessible  to  lower  income  persons. 

(i)  Timely  public  input  into  and  review  of  line-item 
school  budgets. 

Following  are  conclusions  about  tentative  policies  affecting  specific 
decisions  on  innovations  in  instructional  materials. 
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(1)  Choices  at  lower  governance  levels  (especially  at  or  below 
the  local  district)  (a)  are  made  primarily  among  packages, 
(b)  are  made  within  set  standards,   and  (c)  fit  well- 
specified slots;  that  is  few  significant  stru_ctural_.cha^ 
can  be  made. 

(2)  The  decision  process  is  organized  well  enough  to  require 
(or  provide  incentives  for)  many  technical  changes, 
especially  in  teaching  style,   so  long  as  the  labor/ 
capital  ratio  is  not  disturbed  and  major  teacher  re- 
training or  role  differentiation  is  not  required. 

(3)  The  decision  process  has  major  disincentives  relative  to 
pluralization  of  curriculum  content;  such  disincentives 
are  based  on  economics  and  the  naive  images  of  "equal 
opportunity. 

(4)  Florida's  new  school- site  governance  probably  will  not 
produce  real  change  in  the  local  curriculum  unless  accom- 
panied by  (a)  a  change  in  the  way  curriculum  standards 
and  criteria  are  set  and  (b)  pressures  on  producers  for 
alternative  curriculum  packages, 

(5)  The  quickest  way  to  achieve  real  change  in  classroom 
instructional  materials  selection  and  evaluation  is  to 
manipulate  the  standards  for  assessment.    Therefore,  NIE 
might  focus  on  how  the  "national  assessment"  task  can  be 
improved,  expanded,   and_best  governed  (for  example,  by 
giving  federal  funds  only  to  those  who-  get  results). 

(6)  (Standardized)  assessment  ought  to  evaluate  mininrum  com- 
mon ends  rather  than  try  to  enforce  standard  means. 

(7)  Standards  for  instructional  materials  selection  and 
evaluation  can  be  directly  controlled  in  a  centralized 
system;  in  a  decentralized  system,  controls  are  symbols 
of  agreement,   and  thus  are  the  result,  not  the  means, 
of  control. 

(8)  A  basic  tension  exists  between  the  ideal  of  providing  a 
shared  experience  and  frame  of  reference  for  all  members 
of  society  and  the  ideal  of  encouraging  pluralism  and 
preservation  of  distinct  cultural  heritages.    This  tension 
explains  why  we  cannot  treat  instructional  materials 
selection  and  evaluation  in  isolation. 

(9)  Adoption  of  a  proven  instructional  material  can  fail  for 
three  policy  reasons  (and  myriad  pragmatic  reasons): 
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(a)  No  mechanism  is  provided  to  identify  or  support  the 
adoption, 

(b)  A  conflict  with  policy  exists  on  one  or  more  charac- 
teristics (often  not  related  to  instructional  effec- 
tiveness) • 

(c)  The  innovation  is  fine  in  isolation,  but  "unhealthy" 
or  unsuited  to  the  adopting  environment, 

(10)  Most  conflicts  over  instructional  materials  are  solved  by 
compromise  designed  to  foster  homogeneity  (for  example, 
no  religion  in  schools  instead  of  differentiated  classes). 
Policy  generally  does  not  favor  differentiation.    We  are 
often  not  legally  allowed  to  agree  to  and  defend  the  right 
and  opportunity  to  be  different,  especially  at  public 
expense,     (Perhaps  the  wrong  issues  are  finding  places  on 
the  agendas  of  higher  level  decision  makers.     For  example, 
the  Florida  legislature  decides  what  shall  be  taught, 
rather  than  attending  to  the  decision  structure  for  the 
selection  and  evaluation  of  instructional  materials  at 
the  district  and  school  site  levels.) 

Following  are  tentative  conclusions  about  existing  needed  trends  in 
our  (NIE'.s)  approach  to  instructional  materials  policy. 

(1)    Existing  trends 

(a)  The  formalization  and  rise  of  a  distinct  fourth  task,' 
that  of  formal  program  evaluation.    The  evidence  lies 
in  the  current  cry  for  economic  accountability."  Con- 
sider, for  example,  California's  Stull  Bill  and  simi- 
lar bills;  the  National  Assessment;  the  increased 
federal  and  state  demand/for  evaluation;  and  the  con- 
tinued growth  in  certification  in  all  professions. 
The  problem  is  to  avoid  "friendly  facism"  (Gross, 
1970;  Harman,  1972). 

(b)  Regional  accreditation  going  national  or  federal 
(probably  federal).    The  government  rather  than 
private  associations  is  growing  in  strength; 

(c)  Growth  in  state  involvement  in  accreditation. 

(d)  Selection  of  instructional  materials  becoming  more 
political  as  decisions  entail  greater  shifts  from 
the  status  quo. 
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(e)    Continuation  of  the  major  conflicts  in  specific  in- 
structional materials  decisions;  for  example,  the 
professional  decision  versus  the  lay  decision  (the 
technical  decision  versus  the  value  decision) ;  in- 
dividualization versus  standardization;  and  the  co- 
hesive versus  the  segmental  (whether  time  series  or 
conceptual). 

Needed  trends  (these  border  on  recommendations) 

(a)  The  curricular  structure  is  a  standoff  of  balanced 
interest,  and  either  of  two  basic  strategies  are 
necessary  for  substantial  change.    The  first  is  to 
shift  the  balance  (for  example,  add  or  subtract  force 
or  motivation  for  interest  groups  by  shifting  re- 
sources) ;  NIE  should  follow  this  strategy.    The  second 
is  to  change  the  structure  of  the  governance  system 
(who  is  pitted  against  whom) ;  NIE  should  argue  for 
this  change  in  both  federal  and  state  legislatures. 

(b)  The  policy  of  no  politics  in  education  is  unrealistic 
and  dysfunctional.     Political  involvement  in  curricu- 
lum should  be  promoted  without  raising  its  "bad" 
connotations  (for  example,  by  referring  to  it  as 
"citizen  participation"  rather  than  as  "politics"). 
Instructional  material  selection  is  too  important 

to  leave  to  educators. 

(c)  In  an  emplo3mient- specialized  and  culturally  plural- 
istic society,  the  search  for  "The  One  Best  System" 
is  dysfunctional;  we  must  legitimize,  promote,  and 
protect  educational  pluralism. 

(d)  The  following  policies  are  worthy  of  promotion: 

1)  Encouraging  variety  in  teacher  training  programs. 
This  policy  will  be  opposed  by  teacher  unions, 
which  will  fear  it  will  break  their  ranks  and 
create  classes  within  the  profession.  States 
now  have  standard  teachers'  credential  programs 
that  promote  sameness,  except  for  differentia- 
tion by  academic  subject  taught  and  years  of 
teaching  experience.  * 

2)  Encouraging  variety  in  standardized  tests  (para- 
.  doxically,  ETS  now  standardizes). 

3)  Encouraging  Schools  to  move  into  career  and  life . 
 plrannlng^(  e  speciral  ly  ^  as  qual  i  ty-  of  - 1  i  f  e  Is  sue  s 

arise), 
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4)  Politicizing  education,  but  calling  it  ^'parent/ 
citizen  participation.'* 

5)  Making  the  standard  setting  a  matter  of  public 
debate. 

6)  Adding  political  skills  to  training  programs 
for  teachers  and  administrators.     (Teach  them 
how  to  go  to  the  public,  not  to  fear  public  in- 
fluence.) 

(e)  NIE  should  encourage  federal  support  of  experimental 
structures  for  instructional  materials  selection  and 
evaluation. 

(f )  Real  "curriculum'*  reform  must  treat  the  whole  ''con- 
nected" beast.     For  example,   the  state  should  be 
treated  as  one  organization,   as  should  perhaps  the 
whole  nation,  or  at  least  a  region. 

(g)  Timing  is  crucial  to  some  instructional  materials 
movements  (for  example,  the  timing  of  Sputnik); 
therefore,  one  must  monitor  and  watch  for  social 
trends. 

(h)  Major  tensions  result  not  only  from  science,  tech- 
nology,  and  scientific  method  versus  society,  values, 
and  politics — as  strategies  for  problem  solving. 
Tensions  are  also  seen  as  innovation  versus  classic 
tradition  (as  evidenced  in  some  prep  schools),  or  as 
the  religious  versus  the  secular  (for  example,  schools 
of  the  Amish,  the  Orthodox  Jews,   and  the  Catholics). 

(i)  NIE  would  benefit  by  monitoring  the  following  aspects 
of  policy  relative  to  instructional  materials  selec- 
tion and  evaluation: 

1)  NIE  should  monitor  policies  that  allocate  re- 
sponsibility for  instructional  materials  selection 
and  evaluation  decisions.     This  will  provide  data 
for  manipulating  this  structure  and  for  planning 
dissemination  strategies  for  specific  products. 

2)  From  the  perspective  of  systems  theory,  NIE  must 
behave  as  a  superordinate  rather  than  coordinate 
policymaker,  if  local  and  school- site  governance 
agents  are  to  be  given  real  opportunity  to  make 
greater  choice.     (It  takes  a  higher  level  to 
ensure  the  freedom  of  the  lower  level  from 
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encroachment  by  the  middle  level.)    This  implies 
engaging  in  real  political  confrontation  with 
the  states  and  collecting  data/testimony  directly 
from  LEAs  and  school  sites. 

A  major  policy  study  is  needed  to  show  how  NIE 
can  begin  assessing  and  articulating  standards 
and  criteria  that  are  used  nationally  to  assess 
and  guide  curriculum  decision  systems. 
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Annex  C 


HOW  THE  CASE  STUDY  STATES  WERE  CHOSEN 


Annex  C 

HCW  THE  CASE  STUDY  STATES  WERE  CHOSEN 

.Colorado^  Pennsylvania^  and  Florida  were  chosen  to  provide  variety 
in  two  dimensions;      demographics  and  political  culture. 

Demographics 

The  case  study  states  were  selected  to  provide  variety  on  the  fol- 
lowing demographic  characteristics  (see  also  Table  C-1); 

•  The  size  of  the  education  budget  for  the  state,  assvuning  that 
some  costs  for  instructional  materials  are  sensitive  to 
economies  of  scale. 

•  The  number  of  school  districts,  as  an  indicator  of  the  number 
of  local  agencies  that  might  participate  in  the  instructional 
materials  selection  and  evaluation  process. 

•  The  average  district  size^  as  an  indicator  of  the  size  of  a 
districtwide  purchase  of  materials. 

Political  Culture 

The  case  study  states  were  selected  to  provide  variety  on  three 
characteristics  of  the  state  education  code  that  indicate  differences 
in  their  basic  philosophies  toward  the  control  of  education  (see  also 
Table  C-2): 


We  also  found  major  differences  among  the  states  in  the  organizational 
structure  of  state- level  educational  governance.    We  did  not  use  this 
dimension,  however,  because  research  to  date  shows  that  such  differences 
do  not  significantly  differentiate  local  school  curricula  (Campbell  and 
Mazzoni,  1974).     They  seem  to  change  only  the  strategy  for  promoting  an 
instiructional  materials  policy  decision,  not  the  actual  outcomes  of  those 
decisions. 
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•  The  locus  of  control  of  minimal  teacher's  salaries 

•  The  locus  of  control  over  the  basic  curriculum 

•  The  locus  of  control  of  textbook  adoption. 


Table  C-1 

DEMOGRAPHIC  COMPARISON  OF  SAMPLE  DISTRICTS 


WITHIN 

CASE  STUDY 
(1971-72) 

STATES 

Statistical  Feature 

Colorado 

Pennsylvania 

Florida 

Size  of  gross  education 
budget  (in  thousands) 

$626,495 

$2,910,107 

$1,380,407 

Number  of  school 
districts 

181 

511 

67 

Average  enrollment  per 
district 

3,118 

4,639 

22,  067 

Table  C-2 

DIFFERENCES  IN  POLITICAL  CULTURE  AS  REFLECTED  IN  THE 
BASIC  PHILOSOPHY  OF  THE  STATE  EDUCATION  CODE 

! 


Policy  Feature 

Colorado 

Pennsylvania 

Florida 

Control  of  minimum 
teacher  salaries 

Local 
district 

State 

Local  district 

Control  of  curric- 
ulum selection 

Local 
district 

Guidelines  from  the 
state,  with  activi- 
ties clearly  dele- 
gated to  the 
district 

State  and  local, 
within  state  guide- 
lines 

Control  of  text- 
book adoption 

Local 
district 

Local  district, 
within  state  guide- 
lines 

Seventy-five  percent 
from  state- approved 
list;  25%  within 
state  guidelines 
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Unique  Features 

In  addition  to  the  characteristics  already  cited^  Colorado  was 
chosen  because  of  the  emphasis  on  local  control  repeatedly  mentioned  by 
Colorado  educators  in  the  footwork  done  for  the  BOCES  topic  (see  Case 
Study  VIII).     Pennsylvania  was  chosen  because  it  has  recently  adopted  a 
structure  that  places  the  CSSO  in  the  governor's  cabinet.     Florida  was 
chosen  because  it  has  recently  adopted  a  program  to  develop  organized 
parental  input  by  means  of  school-site  governance  councils. 
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Annex  D 


TAXONOMY  OF  POLICIES  CONSIDERED  SIGNIFICANT  IN  THE  STUDY  OF 
THE  INSTRUCTIONAL  MATERIALS  SELECTION  AND  ADOPTION  PROCESS 
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